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In this Issue 



Electrophoresis refers lo the movement of molecules through a fluid or gel under 
the influence of an electric field. It is useful for separating the components of a 
mixture, since different molecules move at different rates. Gel electrophoresis 
has become familiar as a result of the DNA spot patterns seen frequently in the 
news media. In capillary electrophoresis (CE), the gel is replaced by a fluid in- 
side a capillary, a glass tube about the size of a hair in diameter and about a 
meter in length. Near the end of the capillary is a detector, which measures the 
amount of light absorbed by the fluid in the capillary. As the various molecules, 
now separated into bands, pass the detector, the detector output voltage de- 
scribes a series of peaks that can be analyzed to determine what was in the 
mixture and how much of each component was present. In some cases, CE makes analyses possible 
that can't be done otherwise. In other cases, it provides useful confirmation of analyses done by other 
methods. For these reasons, CE has become an established separation method along with gas chroma- 
tography (familiar for pollution analysis) and liquid chromatography (drug testing). The article on page 6 
provides a more detailed introduction to this relatively new analytical technique and recounts the history 
of CE research at HP, which has led to the development of the new HP G1600A capillary electrophoresis 
instrument described in the article on page 10. The objectives for the design of this instrument were to 
overcome the perceived limitations of existing instruments in the areas of automation, sensitivity, repro- 
ducibility, usability, and information output. Major contributions to the sensitivity and information objec- 
tives are made by the detector and capillary designs. The detector (page 20) is a diode array detector, 
which measures light absorption over a range of wavelengths, thereby providing spectral information 
that's useful in identifying unknown compounds. Sensitivity is improved by a new optical design of the 
detector and an improved deuterium light source. The detector works either with standard capillaries or 
with capillaries that have an extended lightpath, a bubble three to five times the diameter of the capillary, 
which helps increase the amount of light absorbed, thereby improving the signal-to-noise ratio. Details 
of this "bubble cell" technology can be found in the article on page 62. Contributions to the automation 
and usability objectives are made by the design of the capillary handling and sample injection tech- 
niques (pages 25 and 32), by the separation control electronics and firmware (page 36), and by the user 
interface design (page 44). Capillaries are mounted in cassettes, and all the necessary connections 
between the capillary and the rest of the system are made automatically when the cassette is inserted. 
Temperature control, vial movement and pressurization, capillary flushing, sample injection, and buffer 
liquid replenishment are also handled automatically under program control. The user interface is imple- 
mented in HP ChemStation software running on a personal computer. Analytical methods are developed 
and tested (by simulation) on the ChemStation and downloaded to the CE instrument, where they run 
automatically. The reproducibility of each instrument is verified by an extensive final test procedure as 
described in the article on page 50. CE research at HP is continuing in several areas including the treat- 
ment of capillary surfaces for protein analysis, as described in the article on page 57. 

What happens if your PC's hard disk — or worse, your network server's hard disk — crashes? RAID tech- 
nology (RAID stands for Redundant Array of Inexpensive Disks) offers PC-based systems cost-effective 
data protection against a disk failure by providing an array of disk drives under the command of a single 
controller. HP Disk Array (page 71) delivers RAID data protection along with other features such as pre- 
dictable failure notification, automatic failure detection, and automatic disk-failure recovery. Many RAID 
systems are hard to install and configure and do not make it easy to recover from a disk failure. HP Disk 
Array comes with software utilities that address this problem. The hardware also offers ease-of-use 
features such as automatic identification and the ability to replace a disk drive while the system is in 
operation. 
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COBOL is still the preferred programming language for a large number of critical business applications 
Many companies are now moving these applications to open systems. COBOL SoftBench (page 82i 
gives software developers the tools they need to make this transition without having to rewrite their 
applications in another language such as C or C++ (they can, if they wish, use these languages for some 
routines and COBOL for others). The widely used SoftBench CASE Icomputer-aided software engineer- 
ing) environment provides a highly integrated toolset that includes a program editor, a program builder, a 
static analyzer, a COBOL animator, a COBOL profiler, a file comparator, and email, along with dozens of 
third-party tools. A mouse, a menu-driven user interface, graphical views of complex programs, and 
automation of repetitive tasks using the SoftBench message connector improve productivity and mini- 
mize the learning curve for novice users. 

Two papers in this issue are from the 1994 HP Design Technology Conference ► Designers of a custom 
integrated circuit needed to provide their chip vendor with documentation describing the data path and 
control portion of their chip. The article on page 88 explains how they used commonly available elec- 
tronic schematic capture software to ensure that the documentation they provided always matched the 
descriptions they were using for simulation. ► In designing an interface between a 60-megahertz bus 
and a 120-megahertz bus, one HP design group chose to use standards cells and automatic place and 
route tools instead of a custom design (page 92). They recommend the approach for its reduced risk and 
the ease of making design changes. 

R.P. Dolan 
Editor 



Cover 

Heating a fused silica capillary in preparation for blowing a bubble in the capillary to improve detection 
sensitivity in capillary electrophoresis. The custom microglass lathe used in this process, nicknamed 
BubbleWorld, has four servoed axes and machine vision. (Photograph by BubbleWorld codeveloper 
Gary Gordon.) 



What's Ahead 

The August issue will feature lOOVG-AnyLAN, HP's implementation of the demand priority local area 
network protocol defined by the IEEE 802.12 draft standard. Other articles will cover the HP AccuPage 
optical character recognition technology, a flat panel liquid crystal display, an economic model for soft- 
ware buy-or-build decisions, and benchmark standards for evaluating ASIC supplier performance 
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Capillary Electrophoresis: 

A Product of Technological Fusion 



An introduction to capillary electrophoresis (CE), its different forms, and 
its applications, and the history of CE research at HP, leading to the new 
HP CE instrument described in this issue. 



by Robert R. Hoi low ay 



Electrophoresis is one of the most powerful, if traditional, 
analytical methods. [Melon and hinder. Hardy, and Ellis were 
turn of the century pioneers in the analysis of hiocolloids 
( proteins and carbohydrates). By eiectrophoretie methods 
they were able to work with these previously intractable 
materials. Arne Tiselius ushered in the age of instrumenta- 
tion wtth a demonstration of the first cell for eiectrophoretie 
analysis in the 1940s, and in the 11190s electrophoresis is one 
of the inosl visible icons of science, with TV and newspapers 
daily displaying elect rophoreiic DNA spot pallerns. 

The fused silica capillary, a glass tube aboul the size of a 
hair, is a spin-off of the optical Tiber. II exists more because 
il could be made (by heal-drawing a large glass lube into a 
tiny one) than because it was seen as a powerful analytical 
tool. Il is not surprising that one of its grandest applications, 
capillary electrophoresis (CE), was not foreshadowed. 

\arious workers in the elect rophoreiic Held ( Everaerts. 
Hjerten. Mikkers. Virtanen), while aware of the benefits of 
going to small systems, did not employ the fused silica capil- 
lary. The growth of the method began when a few workers, 
including scholars Jorgensen and Lukacs of the University of 
North Carolina, industrial researchers McManigill and Lauer 
of HP laboratories, and others, not necessarily sophisticated 
in electrophoresis bul aware of I he power of I he capillary in 
gas chromatography (demonstrated by Kay Dandenau and 
Ernie Zerenner of Hewlett-Packard in 1979'), conducted the 
first experiments in fused silica 

Separation Science 

In analytical chemistry, separation is a fundamental process. 
A chemical substance is generally intimately mixed with 
many ol her substances, and its determinalion and identifica- 
tion is made considerably easier by its physical separation 
from the mixture. Thus, analytical chemists have worked 
hard to understand the separation process and to develop 
many modes of separation. 

The separation principle for a particular separal ion method 
is the physical or chemical property that varies in magnitude 
among the subslances in a sample. In chromaiography. for 
example, the separation principle is often chemical affinity 
for chromatographic materials. A feature of CE is that its 
separation principle is orthogonal to that of liquid chro- 
matography ( LC ). or in ol her words, it has a completely 
different basis. 



.Separation implies physical movement or transport. In free 
Solution Capillary electrophoresis (FSCE), the simplest fOTTH 
of CE, transport of a particular chemical species is the resul- 
tant of several driving forces. The species moves in re- 
sponse to an electric field, which is impoiiani if it is 
charged. Il moves in response to the flow in the channel, 
which can be caused by the electric potential difference 
across the fluid-silica interface (electroosmolic flow) or by 
mechanical pumping of the fluid. Finally, its migration is 
affected by the frictional drag il experiences, which depends 
on its size and shape and I he viscosity of I he fluid. 

Modes of CE 

CE is really a group of several procedures. CGE, or capillary 
gel electrophoresis, is an enhancement of an older technique. 
IEF, or isoelectric focusing, has also been done in other for- 
mats, and is slill in the process of adaptation lo the capillary. 
1TP, or isoiachophoresis, has not found wide use bin has 
considerable potential for preparing pure chemicals. MEKC. 
or micellar elect rokinetic chromaiography (also called by 
other acronyms), is a completely new method thai combines 
electrophoresis and partition chromatography. The Simplest 
and most characteristic mode, in terms of which all the 
others can be described, is FSCE. II is the form most 
practiced today. 

Free Solution CE 

In FSCE, a capillary channel, typically a few micrometers lo 
two hundred micrometers in diameter, is filled with a con- 
ducting liquid, most often a water solution containing an acid 
or a base and its salt, termed a buffer, which has a pH thai is 
insensitive to the addition of small amounts of acids or 
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Fig. 2. (a) Hydration of a raw suiia surface to polysiitcic acid, 
(b) Negative charging of silira by ionization of the surface. 

bases. The two ends of the channel are immersed in two res- 
ervoirs which are held at different electric potentials: in oilier 
words, a voltage is applied to the column. In the most usual 
situation, this will result in the flow of the liquid from the 
anodic reservoir to the cathodic reservoir. This is eleetroos- 
motic flow (Fig. 1 ). 

Eleetroosmotic Flow 

The surface of silica in contact with an aqueous medium 
with a pH no lower than 2.5 or so is loaded with negative 
charge. This is because silica hydrates and becomes an acid, 
releasing positive hydrogen ions into the medium (Fig. 2). 
The excess positive charge is physically localized within a 
very narrow zone close to the surface ( Fig. 3). 

Since capillaries enclose very small channels, and since elec- 
Irophoretic currents are proportional to the cross-sectional 
area of the channel, FSC'E involves small currents ( from a 
fraction of a microampere to a hundred microamperes or 
sol and thus small amounts of heat relative to conventional 
scales of electrophoresis As a result it is possible to apply 
much larger voltages, and axial electric fields in the channel 
are high- hundreds of volis per centimeter. 

Water molecules in the narrow zone of positive charge are 
subjected to the pull of the positive charge as it moves to 
the cathode. In fact, the entire column of fluid is dragged. In 
contrast to what would happen if Ibis same column of Quid 
were moved by a piston, there is no laminar flow, no wall 
drag lending to produce a parabolic How profile (I'oiseulle 
How). The flow is proportional to the electric field, and can 
reach a velocity of millimeters per second. 

Transport 

At lite anode a thin zone of a mixture of analyies in aqueous 
solution is introduced into the capillary. The molecules in 
the zone are immediately subject lo ihe strong electric field 
and Ihe bulk flow of Ihe elect rolytc. They are impeded by 

ihe molecules of electrolyte through winch they musl move. 

The different species each move with a characteristic veloc- 
ity. In general, they move toward Ihe cathode, but if strongly 
negative, can actually be expelled inlo Ihe anodic reservoir. 
As they move, they separate inlo hands enriched in Ihe 
various species relative to the original mixture band. 



The most spectacular feature of CE is that the molecules in 
a band are subject to very little dispersion while traveling 
along the column. The flow in the column does not appreci- 
ably stir up the baud, because it is a flat-profile flow. Diffu- 
sion is inescapable and does spread the baud, bul because 
the experiment is very fast, not much diffusion occurs. In 
the CGE form of the technique, the medium is a gel, diffu- 
sion is drastically slowed, and prodigious resolution is 
achievable. 

Somewhere along the tulie. as close as possible to the cath- 
ode, a detector is mounted to visualize the bands as they 
pass. Since silica is transparent to ultraviolet radiation, the 
most convenient detector consists of a lamp on one side of 
the column and a photodeteetor on the other side. The bands 
absorb the light as they move into the path of the lamp rays, 
and the signal is displayed as a series of peaks similar to the 
familiar peaks of chromatography, although unlike chromaio- 
graphic peaks the quantity of material represented by a par- 
ticular peak depends on when it passes the detector as well 
as its size. Figs. 4 and 5 show typical electropherograms 
obtained by FSC'E and CGE. respectively. 

GE Applications 

The mature practice of electrophoresis and the new tecluii il- 
ogy of fused silica capillaries have been combined to perform 
previously unrealized analyses (CGE for the quantitation of 
oligonucleotide failure sequenc es and automatable DNA se- 
quencing), to perform others with unprecedented speed and 
resolution (faster DNA restriction fragment length poy- 
morphism (RFLP) analysis and peptide mapping than liquid 
chromatography), and to provide a badly needed orthogo- 
nal separation principle for all liquid-phase analysis (Ihe 
combination of charge and frictionnl drag). CE is not just 
an incremental improvement on existing methods; rather, it 
allows entirely new things lo be done. Il is lliis paradigm- 
shifting character thai makes CE attractive in an industry 
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thai, while not growing as explosively as the computer in- 
dustry, lias been changing rapidly, with products liecoming 
obsolete in a matter of months. 

Most of the separations performed in the mainstream chemi- 
cal industry, as well as the food and drug industries, can be 
carried out and are being tried by CE. In some instances, 
notably the large-molecule areas of bioscience, good appli- 
cations have already been found and are on their way lo 
validation. In many others, sometimes surprising ones in- 
volving molecules with no charge differences, there is great 
interest. The high resolving power of CE sometimes out- 
weighs an inappropriate separation principle, for example in 
the case of chiral drug molecules. These molecules are un- 
charged and have the same frictional drag and therefore 
cannot be separated with ordinary media. Their separation 
in CE comes from transport through a medium that is itself 
chiral. and the low dispersion of electroosniotic transport 
preserves it ftw examination. 

CE and the Bioanalytical Market 

In the biOtechnlcal segment of the analytical chemical market 
IIP has had only a few products. One of the most important 
is the liquid chromatography (LC) system, which is used to 
characterize chemical products and validate their identities 
(traditional quality control). LC is very powerful in the Field 
of general chemicals, along with gas chromatography (GC). 
but the new bioengineered pharmaceuticals, the nucleic 
acids, and peptides and proteins challenge even its power. 
CE is a welcome partner method that shows promise in solv- 
ing some of these challenges. 

Oligonucleotide Failure Sequences 

The oligonucleotide, which is a sequence of molecular letters 
of DNA code, is used in the research and development effort 
in the new biotechnical industry. These segments, a few to 
perhaps a handled letters in length, are synthesized lo be 
used as templates, or more properly stencils, for operations 
that create large amounts of the informational molecule 
(polymerase chain reactions or PCR) or as implements for 



the manipulation and recognition of critically important 
1>NA molecules, such as those that cause inherited trails 
(genetic diseases) or those thai can identify individuals. The 
synthesis of these molecules is carried out one letter at a 
time and is prone lo mistakes at each step. After a series of 
steps, a population of failure sequences exists along with 
the desired materials. These mistakes are most easily de- 
tected and quant itated by capillary gel electrophoresis 
(CGE). Neither the traditional slab gel techniques of electro- 
phoresis nor LC has the resolving power to distinguish the 
authentic material from these attendant failures. 

Peptide Mapping 

In FSCE, the most important mode in terms of the number 
of analyses carried out, an important bioanalytical target is 
the protein digest. Most of the bioengineered pharmaceuti- 
cals being produced OT contemplated are proteinaceous. 
The identity of a protein product is determined by using 
specific proteins to break it down catalyiically into a mix- 
ture of smaller proteins (peptides) which identifies its origin 
just as a geometrical pattern of closely spaced curved ridges 
identifies the fingertip on which it occurs. The peptide mix- 
ture can be analyzed with LC lo produce the molecular ana- 
log of the fingerprint, called a peptide map. The mixture can 
alSO be analyzed with CE to produce an equally characteris- 
tic map more quickly. Both maps are useful, and at this stage 
of manufacturing practice, their complementarity is begin- 
ning to be widely appreciated. 

The Future of CE: Integrated Liquid-Phase Analysis 

CE will continue to find applications. Its growth rate as a 
liquid-phase analytical method will be higher than its more 
mature cousin, LC. Most of LC's applications are firmly en- 
trenched and sufficient for immediate needs. Improvements 
in these will be incremental enhancements involving a vari- 
ety »f techniques including CE. 

CE in the future will likely be a part of a complex strategy. 
Workers are now combining the unique separating power 
and efficiency of CE with the versatility of LC and the mass 
spectrometer's ability lo identify unknow ns. New forms of 
separation continue to spin off the CE experiment (most re- 
cently CEC, or capillaiy electrochromatography) and will also 
play a part in the integrated future of liquid-phase analysis. 
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HP Laboratories and CE 

Douglass McManigill of HP Laboratories ln-came interested in 
CE as a result of the publication of Professor Jim Jorgenson's 
first paper describing the use of fused silica capillaries for 
electrophoresis. 2 McManigill. in what is now the chemical 
systems department of the Analytical/Medical Laboratory- of 
HP I-aboratories, was working in the area of supercritical 
fluid chromatography, but was intensely interested in the 
physics of transport proct-sses. Along with Henk Lauer of the 
HP Waldbronn Analytical Division, he built a CE apparaius 
and began an investigation of the CE separation process. 

At roughly the same time. Paul Bente and Joel Myerson of 
HP Uenenchem were working on an electrophoresis instru- 
ment to do gel separations of proteins and peptides. While 
they had limited success instrumental, the pressurized gel 
synthesis they invented was the only reproducible technique 
for making the gels for several years. 

In time. Latter left the company, and over several years. 
McManigill led the project, working with many others, in- 
cluding Sally Swedherg. who later worked in Waldbronn on 
CE, mechanical engineer Stu Lerner. who is no longer with 
HP, Jim Young, mechanical engineer and designer whose 
contributions included a method of coating columns with a 
resistive layer, Mark Bateman, computer scientist and elec- 
trical engineer, who created the first software for I hi- instru- 
ment. mechanical engineer John Christianson. who worked 
on the first prototype and is now at the HP Vancouver Divi- 
sion, the author, a chemist from the medical group at HP Lab- 
oratories, Don Rose from Jorgenson's group at the University 
of North Carolina Jiirgen Lux from Max-Planck Institut fiir 
Kohleforschung in Mulhcini, Germany, Cathy Keely, an 
engineer who made hundreds of CE runs to explore the 



unexpected behavior of columns with a conductive coat- 
ing, Tom van de Goor, a former student of Everaerts in Eind- 
hoven, the Netherlands, who also joined the study of the 
control of electroosmotic flow, and Wes C ole, an electrical 
engineer who modeled electric fields at the ends of capil- 
laries. 

Another group at HP Laboratories, led by Gary Gordon, 
worked on several issues surrounding a CE instrument. 
Physicist Dick Lacey helped design a detector. Gary devel- 
oped the "bubble cell." which offers a greater optical path 
length. An automated system for the fabrication of bubble 
cell capillaries was developed by Rich Telia, Henrique 
Man ins. Bill Gong, and Frank Lucia of the manufacturing 
systems and technology department. 

Christmas season 1989 saw the transfer of HP Laboratories 
technology into the capable hands of Alfred Maute. Fred 
Siiohmeier, Martin Bauerle. Frit/. Bek, Franz Bertsch. Bern- 
hard Dehmer, Monika Dittmann, I'lrike Jegle. Patrick Kal- 
teuhach. Alwin Ritzmann. Werner Schneider. Klaus Witt, and 
Hans-Peter Zimmerman of the Waldbronn Analytical Divi- 
sion. The result is the instrument described in this issue. 

The help of Doug McManigill is acknowledged in the con- 
struction of this history. 
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A New High-Performance Capillary 
Electrophoresis Instrument 



This instrument automates the CE separation process with high 
reproducibility of analytical results such as peak areas and migration 
times. A diode array detector with an optimized optical path including a 
new extended lightpath capillary provides spectral information with high 
detection sensitivity. The liquid handling and sample injection systems are 
designed for flexibility and usability. 



by Fred Strohnieier 



Electrophoresis on planar gels (gel electrophoresis) has 
been well-known for decades as a scheme for separating 
sample constituents. Capillary electrophoresis (CE), on the 
oilier hand, is an entirely new type of separation methodol- 
ogy. The challenges for insirumenl design stem from the Tact 
that the separation lakes place in a capillary wilh an inner 
diameter of approximately to 100 mieroiuelers. Samples 
analyzed in such instruments have a volume of a few nano- 
liters, while the total volume of the capillary is a few micro- 
liters. Miniature dimensions like this require totally different 
ways of thinking in terms of technical implementation. 

Project ami Product Goals 

When IIP made the strategic decision to invest in syslem 
development for the electrophoresis market (instrument, 
workstation, and capillaries, including Ihe related chemis- 
try), il was evident I hat CE as a separation methodology was 
still in its infantile stage. It was either just being investigated 
or, in advanced instances, being used for new application 
development, for example in the search for new pharmaceu- 
tical substances. Most instruments were homemade systems 
composed of barely modified HPLC (high-performance liquid 
chromatography) equipment wilh an additional high-vollage 
power supply. Analyses were performed in an almost 
manual manner. As applications were developed it became 
obvious that instrumental imperfections were beginning to 
limit further acceptance of CE. Many complaints and short- 
comings were staled by potential and real CE customers, 
who most often worked in an environment where 11 PLC was 
the method of choice for most analytical tasks. The most 
important limitations were missing functionality, lack of 
automation, not enough sensitivity, and low performance. 

There were a few commercial instruments at Ihe lime, each 
type designed to solve a specific CE problem, but no attempt 
had yet been made to address all of the perceived apparatus 
limitations in one instrument. Before the HP instrument de- 
velopment was started I he user needs were confirmed 
through numerous customer visits in different market seg- 
ments. For the project team it became apparent that we had 
to make significant improvements in the slate of the art in 
the following areas: 
• Automation of the overall analysis process 



• Detection sensitivity ( ultravioletAisible light absorption) 

• Compound identification through spectral information 

• Reproducibility of the analytical results (migration time, 
peak area ) 

• Usability (mainly capillary handling). 

All development activities were driven by these goals. For 
instrumental functions that were not directly related to this 

priority list we Hied to find ;ui off-l he-shelf solution within 
or outside HP. 

Instrument Architecture 

To provide total control over all parameters relevant to the 
quality of a separation, an integrated architecture was cho- 
sen. All of the functional modules such as the detector, auto- 
sampler, injection module, and capillary are within one main- 
frame ( see Fig. 1) where all of the interfaces are well-defined. 
This architectural approach makes it much easier to imple- 
ment a single point of control concept However, the internal 
structure of the instrument is modular as shown in Fig. 2. 

The instrument is basically divided into two major modules: 
the detector module and the separation Unit They are kepi 
strictly separ ate not only from a hardware point of view but 
also with respect to control (each has its own HP-IB inter- 
face). This structure provides Ihe flexibility for future up- 
grades such as adding oilier detectors to the system. The 
coordination of the analysis, in which both modules have to 
be synchronized, is handled by the PC-based HP Chem- 
Station, From there Ihe method set up by the user is down- 
loaded to the detector and the separation unit, and when the 
analysis is started the method is executed Simultaneously by 
both modules. There is no communication between these 
two modules except for external start/slop, not ready, and 
error signals, which conforms to an HP standard for inter- 
module communication. 

A physical connection between the modules is provided by 
the capillary. The inlet end of the capillary is adjacent to the 
separation unit, allowing the autosampler to immerse the 
capillary tip into Ihe sample or a buffer. The major part of 
the capillary is within the cassette for thermal control pur- 
poses. Before il leaves the cassette again the capillary is 
guided through Ihe optical path of the detector, where the 
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Fig. 1. Tl»' HP QlfiOQA <"E instrument is contained wiilun a 
single mainframe and uses a PC-based IIP OhemStatiiiM fur 

mill ml 

sample undergoes detection. Tlir outlet end. like the iiilel 
end, is adjacent If) the separation module where (he aulo- 
sampler has access lo the capillary lips. 



changing of the capillary, either because the application has 
changed or because the lifetime of the capillary has expired. 
Before insertion into the instrument, the capillary is posi- 
tioned in a forced-air-cooled cassette. This design approach 
has many benefits for the user. Using air as a cooling medium 
makes the system totally uncritical compared to a liquid 
cooling system whose connectors are prone to leaks. Even 
though liquid cooling in principle has a higher cooling effi- 
ciency, litis bent'fil is outweighed by the fact that only highly 
electrically resistant cooling liquids ic.g.. peril uorcarbon) 
can be used and these have a lower thermal conductivity 
than water and are very' expensive. With air cooling the cas- 
sette design can Ik- kept very simple because there are no 
special connectors to interface lo the cooling fluid other 
than conduits to allow the airstreani to flow through Thus, 
cassettes can be exchanged without any precautions. All 
critical interface requirements, such as sealing the capillary 
against the injection vial and aligning the capillary with re- 
spect to the optical path, are shifted to the insirument where 
they are easier to solve. For all of these reasons the price of a 
cassette is very reasonable. The cassette is designed so that 
the detector interface is sell-aligning with respect to the opti- 
cal axis. The capillary' ends are caught and guided into final 
position when the user slides the cassette into the instru- 
ment Sealing against the fluid system is automatic. 

For high-efficiency cooling, the airstream temperature is 
controlled using Peltier elements. The forced air allows fast 
equilibration of the system in case the temperature seipoint 
changes. The operating range is from IOC below ambient 
temperature to 60*C The temperature is sensed within the 
airstreani. The heal exchanger temperature is sensed to 
measure cooling efficiency, which is optimized by adaptive 
control algorithms. The overall precision Of the temperature 
Control system is±0.1°C. Because of this precision, the re- 
peatability of migration time and peak area measurements is 
very good. 



Separation Environment 

From a usability perspective the most critical design aspect is 
the way the capillary is interfaced lo the infrastructure re- 
quired to perforin an elect rophoretic separation (see Fig. :}). 

Besides filling the atitosampler with sample and buffer vials, 
the most frequent user interaction with the instrument is the 



Detection 

The detector built into the IIP CE instnimenl is based on a 
I Wis (ultraviolet and visible light ) absorption detection 
scheme. A diode array Spectrograph provides parallel read- 
out of all wavelengths shining through the capillary, thus 
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Capillary Electrophoresis Applications 



Capillary electrophoresis was initially regarded as an analytical separation tool tor 
proteins and peptides Its characteristics imply thai biornacrornolecules theoreti- 
cally should take the biggest advantage ot the technique However, it has turned 
out that more then a decade after the birth o( the technique the applications have 
spread into many more areas than just the bioscience area In fact, tor many proteins 
it has proven to be a bit of a problem to get a separation with the required high 
sensitivity using the fused silica columns All in all this has not hindered the growth 
of the technique. When the first commercial instruments became available in 
199(1 the market was estimated to be several million dollars in size In 1994 the 
expected market size might very well reach 50 million dollars The main user 
groups of CE are found in the pharmaceutical market loom traditional and biuphar- 
maceuticalsl, the bioscience market, and the chemical industry (see Table I) 

Although still mainly in use in R&D laboratories, the technique is definitely migrat- 
ing towards controlled analytical laboratories such as OA/QC and product testing 
labs This indicates that the technique does otter unique benefits anil can expect 
sustained growth in the future 



Market Segment 

Pharmaceutical Industry 
Bioscience 
Chemical Industry 
Fuod/Beverages 
Others 



Table I 
CE Users 



Estimated Share (%) 

35 
35 
20 

5 

5 



Some successful applications of CE include 

Analysis of optical impurities Ichiral analysis) (see Fig, 1 1 

Tryptic digest analysis of recombinant biopharmaceutical drugs (peptide 

mapping) (see Fig. 2) 

DNA analysis (e g . PCR product analysis) (see Fig. 3) 
Organic acid analysis |e g . in beverages) (see Fig. 4) 
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Sample: Chiral Mixture 

Buffer: 20 mM citrale, pH 2.5, 2% Carboxymethyl-|i-CD 

Capillary: L 0 ff = 56 cm, L = 64.5 cm, i.d. a 75 urn 

Injection: 200mbar s 

Electric Field: 300 V/cm 

Detection: Signal 214.20 nm, Ret. 450.80 nm 

Temperature: Capillary 20 C 

fig. 1. Capillary electrophoresis ICEI separation nf a mixture nl basic chiral drugs 
using cydoflextrin as chiral selector 
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Fig. 2. Repetitive separarion of a tryptic digest ot recombinant buman growth hor- 
mone by CE 



providing spectral information. This type of detector has 
several inherent features that have proved useful for many 
applications: 

• Identification. Absorption spectra make it possible to posi- 
tively identify suhstanees by their sped nil "fingerprints." 
The HP t 'hemStalion controlling the instrument has a 
built-in spectral library'. Library searches can be performed, 
resulting in suggestions of substances that have similar 
spectra. They are ranked according to a computed match 
factor. 



• Confirmation. Spectra created by liquid chromatography 
separations and capillary electrophoresis separations for 
the same substance are, with a few exceptions, identical. 
Based on this, the spectra obtained with these two separa- 
tion techniques are confirmatory or redundant to each other 
for a given sample constituent. Since the two separation 
techniques have different separation mechanisms it is very 
unlikely lhat a sample constituent or impurity will be 
missed by both LC and CE. 
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Carousel 10 C 



fig. 3. Separation of PCH products using cap- 
illary gel electrophoresis 



Application 

Chiral Analysis 

Peptide Mapping 
0NA Analysis 



Table II 
CE Applications and Benefits 



Other Analysis Methods 

HPLC. GC.TLC. SFC 

HPIC 



Slab Gel Electrophoresis, 
HPIC 



CE Benefits 



Speed 

Easy Method Development 
Cost of Analysis 

Speed 

Orthogonal Mechanism 

Superim Resolution 
Speed 

Online Quantitation 



All of these applications have in common that CE offers significant benefits over 
previously existing techniques (see Table II). 

The future outlook foi CE is positive although further development ot capillaries 
suitable for protein analysis under native conditions anil the development of othei 
detection modules such as CE MS will be important for long-term establishment 
of Hie technique. 
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Buffer: 5 mM phthalate, 0 25 inM CTAC. 0 07% |t-CD, pH 3.5 

Sample: Sake (diluted 1:5 with walerl 
Capillary l c „ - 56 cm, L ■ 64.5 cm, i d. = 75 nm 
Inieclion: 200 mbar s 
Temperature: 15 c 

Field Slrengih 390 Wcm, Reversed Polarity 

Fig. 4. Analysis ul uiganit acids in sake employing initiier.r UV detection 



• Peak Purity Measurement. The fact thai a Spectrum is 
characteristic for a c ertain substance can l>e used to mea- 
sure peak purity U tile spectra sampled along llie peak arc 
identical, I he peak can lie assumed In lie pure. If the spectra 

change along live peak, a second substance might have 

coelllted. 

Even though diode array detection is a desiralile feature, it 
would lie unacceptable if the sensitivity wen- not competitive 
with conventional l A Wis detectors such as single-wavelength 

detectors 01 variable wavelength detectors, which work with 
filler wheels, bandpass filters, or rotating monochromalor 

gratingSi thus providing sequential spectra. Peak widths in 

CE are inherently smaller than in L< '. The time needed by a 
scanning variable wavelength detector for scanning through 



die full spectral range cannot be neglected. This makes these 
detectors less preferable for spectral identification in capillary 
electrophoresis. However, the sensitivity of monochromator- 
biLsed detectors is viewed as the slate of the art in CE. 

To obtain the same level of sensitivity with the diode array 
based spectrometer of the IIP CE system, special care was 
given to the optical design of the ( 'E detector. As described 
in more detail in the article on page 21), the objective was to 
optimize the light throughput and therefore the light incident 
Onto the photodiodes, which determines the lowest noise 
level achievable with ;ui optical detector. To maximize dA/dc, 
where dA is Ihe incremental absorption change and dc is the 
incremental concentration change of the fluid residing in Ihe 
optical path, all light emitted by Ihe lamp is focused onto Ihe 
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Fig. 3. Capillary interlaces to the instrument Infrastructure. 

capillary such thai almost all rays pass through the inner 
diameter of the capillary and only a minimum of light (stray 
light ) passes through the capillary wall without any interac- 
tion with ihe liquid inside the capillary The benefits of this 
design optimization are: 

High light throughput The resull is an excellent noise level 
in (lie order of 2x10"° to 5x10"° All (absorption units). This, 
combined with Ihe low stray lighi level, provides superior 
sensitivity. 

Low stray light lev el. Besides excellent sensitivity, this results 
in a wifle linear dynamic- range, meaning that the detector 
responds linearly lo an increasing sample concentration. 
The relevance of this feature can best be seen in a ploi such 
as Fig. 4, which shows a synthetic polyiysine preparation 
analyzed with CE. 1 The wide linear dynamic range makes it 
possible lo quantify the smaller peaks (byproducts) relative 
lo Ihe main peak (active substance) very accurately. 

The most remarkable feature of Ihe detection system is the 
extended lighlpath capillary', internally called Ihe "bubble 



cell." By expanding ihe inner diameter of the capillary in the 
detection region by a "bubble factor" of BF (typically BF = 
-i ) the sensitivity is linearly increased by a factor of BF ac- 
cording to ihe Lambert-Beer law.- assuming lltat the noise 
level of the detector is unchanged. This bubble cell makes 
Ihe diotle array detector one of the most sensitive optical 
absorption detectors. The larger inner diameter al Ihe point 
of detection makes ii possible lo achieve a very low si ray 
light level since more light rays can pass through Ihe center 
of the capillary, thus increasing Ihe linear dynamic range to 
0000 (see page 23 for definition). 

The IIP CE diotle array deleft or is also compatible with 
standard off-l hi '-shelf capillaries. Different detector interfaces 
are available for the different inner diameters of capillaries 
wit h and without bubbles. 

Liquid Handling 

The purpose of the liquid handling functional module is lo 
provide Ihe necessary liquids to both ends of the capillary lo 
facilitate a CE analysis. This includes electrolytes as well as 
samples, cleaning solvents, and waste vessels, as shown in 
Fig. 5. The module automates liquitl handling so (hat Ihe 
whole analysis can be done automatically and repetitively. 

The two major design elements of the liquid handling module 
are the single-tray autosampler. which conveys \ials lo bolh 
ends of the capillary, and Ihe replenishment system. The 
autosampler nay is designed so thai il can position vials 
under both ends of Ihe capillary independently and randomly. 
This enables Ihe system lo do analysis steps not possible 
with many oilier instruments. 
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Fig. 4. Elcotroplierograin of a synthetic imlylysuie preparation with 850 lysine residues. 1 
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Random selection of the autosampler positions (there are 4S 
accessible positions) allows the user to select between sam- 
ple, buffer, waste, and fraction collec tion \ials. This gives 
high flexibility to the customer since the number of tray 
positions can be split according to the requirements of the 
application run on the instrument. When the same analytical 
method is being run in a repetitive mode, the buffer replen- 
ishment system can be employed and most positions can be 
fiEed with samples to be analyzed, thus providing maximum 
sample throughput. 

Fractions of separated sample constituents are collected in 
a vial filled with a minimum volume of buffer. This is of par- 
ticular importance for any further offline identification, for 
example with a mass spectrometer' or for further analysis 
with any other separation technique such as peptide/protein 
sequencing by Edman degradation. 

Samples can be injected on both ends of the capillar.'- Isually 
;ui injection is done on the end Farthest from the point of 
detection. However, for fast screening experiments it may 
be desirable to make a run on the short part of the capillary 
to save time. Reinjection from already collected sample 
fractions is also possible. 

Buffer vials can be exchanged during analysis, independently 
on both ends of the capillary. For many applications it is 
mandatory to have this capability to complete a separation. 
For example, in isoelectric focusing mode the buffer change 
in pH can be used to transport the separated sample bands 
tlirough the detector. 

The replenishment system is primarily for the purpose of 
refreshing the buffers in the buffer vials by simply exchang- 
ing the contents of the vials with fresh buffer. This is re- 
quired because the buffer undergoes chemical degradation 
by electrolysis which leads first to irrcproducibility and in 
later stages to a shift of the pi I resulting in a totally changed 
separation pattern. For unattended automated operation 
with high sample throughput, buffer replenishment is a man- 
datory feature, guaranteeing the highest reproducibility. 
Furthermore, the replenishment station adds other func- 
tions, including filling an empty vial to a selectable height or 
volume, emptying a vial to a selectable height, and sample 
or buffeT dilution by adding buffet to a vial. This additional 
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functionality also adds some basic sample preparation capa- 
bilities to the system. By ensuring the same liquid level in all 
vials, hydrodynamic flow effects are avoided, since no head 
pressure difference can occur. 

Pressure Injection 

Because of the small volumes associated with CE. injection 
mechanisms employed in LC cannot be used in CE. For 
open capillaries (not filled with sieving matrices like gels) 
the most common injection mechanism is to apply a pres- 
sure differential across the capillaries. The volume injected 
follows the Hagen Poiseuille law: 



Volume = 



Apd 4 t 
128rjt 



Fig. 5. The HI' t'E instrument liquid handling system includes 
:ui gruioaarnpler with random vial accwa (torn three lifts. 



where Ap is the pressure differential, d is the capillary diam- 
eter, r| is the viscosity of the buffer. I. is the total capillary 
length, and t is the time during which pressure is applied. For 
a given capillary the volume injected is basically the integral 
of the pressure-versus-time curve. The more precisely the 
pressure/time product is controlled, the more reproducible 
is the injection volume. 

In the HP ("E instrument the pressure/time product is con- 
trolled online and corrected immediately if any deviations are 
recognized from the programmed curve. Leaks in the system, 
which would result in a smaller injection volume, are auto- 
matically compensated by this procedure. The pressure is 
applied as a triangular function. On the downslope of this 
triangular pressure function, a vent valve is opened when 
the pressure is approximately equal to the ambient pressure. 
This has the advantage that the switching deviations of the 
vent valve have no significant impact on injection volume 
reproducibility. The pressure control algorithm significantly 
improves the reproducibility of the pressure injection sys- 
tem, as explained in detail in the article on page 50. 

Pressure injection has some inherent advantages over injec- 
tion by vacuum. The outlet of the capillary is nut accessed 
during injection; this is important if other detection means 
like mass spectrometers are coupled to the CE instrument 
Degassing and therefore air bubble formation in the capillary' 
cannot occur, and fraction collection is much easier. Never- 
theless, the design of the pressure system allows the user to 
apply a vacuum to facilitate injections from the detector end 
(shorter separation length), which may be important for fast 
screening experiments. 

Elect rokinetic Injection 

Electrokinctic or elect roinigration injection is achieved by 
pulling the sample into the capillary by applying an electric 
field for a certain lime. The quantity injected can be calcu- 
lated. 1 This injection method is advantageous when viscous 
media or gels are employed in the capillary and when hydro- 
dynamic injection does not work adequately. Basically, the 
volume injected is proportional to the charge introduced 
into the capillary. The IIP CE instrument provides for the 
application of a voltage or a current for a certain time 
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HP CE Technology Transfer 



Looking al the new product generation process, often there is a long chain of 
activities involved, starling from basic research and proceeding to applied research, 
technology development, new product development, and finally, manufacturing 
Later, while the product is being marketed, an improved and enhanced series of 
products will be generated in an R&D process sometimes referred to as current 
product engineering Throughout this sequence of steps, knowledge, experience 
and competence are being built up. hopefully in a continuous, smooth, unidirec- 
tional way. However, since many people and different organizations are involved, 
losses, frictions, and interfacing issues associated with the transfer of know-how 
will occur and must be resolved or at least kept to a minimal negative impact. 

Unlike the typical situation of 20 years ago. when the same group of people carried 
out the entire new product generation process all the way from research to manu- 
facturing through many sequential steps, the scenarios of today's new product 
research and development projects have changed considerably Given the complexity 
and breadth of most ol HP's products, not only the analytical products, there is no 
way of making all of the key components entirely within HP Instead, many things 
have to be acquired from external parties in various stages of development, fie it 
fundamental research results, patented technology, methods, processes, or other 
know-how. In many situations even complete products or system components 
come from outside sources 

In our case of adding CE to the LPA (liquid phase analysis] product line, certainly we 
did look at the alternatives of acquisitions or external R&D collaborations, but 
before the final decision was made to take advantage of the accomplishments of an 
HP Laboratories research project and transfer technology and know-how from there 
to the Waldbronn Analytical Division and plunge into new product development, 
we had been thinking about mechanisms of technology transfer in general, and 
tried to reflect our conclusions in the organizational structure of our R&D function 

Generally, R&D divides its forces into activities of current product support and 
enhancement, development of next-generation products, and investigations, 
which include new products, new technology, key components, and lundamental 
research The size of each of these segments depends on the business situation. 



The injection time table allows combinations of different 
modes of injection as well as flushing using randomly .select- 
able vials. This makes it possible to do various Sample ma- 
nipulation steps that are essential for many applications. 
These include adding an external standard by injecting a 
plug of a standard compound, and adding a buffer with dif- 
ferent conductivity to do sample stacking (enrichment) 
using the isotachophoresis effect. 

Data Acquisition and Data Analysis 

The software running on the PC next to the instrument has 
two major components: an instrument control module 1 and a 
data collection and data analysis module. 

Instrument Control. The functionality and versatility of the HP 
CE instrument made control by a PC the method of choice 
for handling the multiplicity of parameters and settings. The 
objective for the software design was to make the process 
of CE graphically visible and give the user continuous feed- 
back on what the instrument currently is doing. As a design 
concept for the instrument control software an icon-based 
system was chosen. All instrument modules and their func- 
tions are symbolized. The user is shown a graphical repre- 
sentation of the instrument. Clicking on an icon displays a 



which may change quickly. There is always a temptation to sacrifice the long-term 
investigations for short-term, market-driven problems or opportunities. 

To stabilize the long-term, high-risk, but strategically important protects against 
the pressure of the tactical projects, we decided to divide the R&D function into 
two units: a smaller unit focusing on development, acquisition, and transfer of 
new techniques and generic components and a larger unit focusing on current and 
next-generation product development The structure ol the technology unit reflects 
the major technical and functional areas of the product line and therefore this unit 
has a few resident engineers and scientists who are specialists and experts in 
those categories. A larger number of members are set up in transient project 
teams and remain in the technology unit only during acquisition or investigation 
phases. We then transfer the project together with the transient team into the 
product development environment. This model should ensure minimal loss of 
know-how in the transfer from Ihe investigation phase to the lab engineering 
phase and still keep a stable base of technical expertise and competence beyond 
one particular project cycle In addition, it helps synchronize projects of different 
time scales and keeps the rules of the project life cycle flexible enough to adapt to 
new product design as well as to current product engineering 

The HP CE project was the first technology transfer project to be completed under 
this organizational structure and following these rules. The technology transfer 
from HP Laboratories to the Waldbronn Analytical Division yielded a very successful 
product We have transferred technology from HP laboratories before, but this 
transfer in particular went smoothly and pleasantly, I tend to believe, because of the 
new organizational model, but as much because of the enthusiasm, the dedication, 
and the support of the engineers and managers involved on both ends, including 
our marketing, manufacturing, and business people. 

Alfred Maute 
Engineering Manager 
Technology Center 
Waldbronn Analytical Division 



pop-up menu that offers the user the settings for that func- 
lion. The entries jure checked for plausibility and proper set- 
ting ranges. The HP ChemStation displays the status of cer- 
tain events by changing colors, by showing the action taken, 
or by highlighting a setting the user has ediled. The user ran 
program the following parameters as functions of lime: 

• Replenishment 

• Prerun and postrun conditioning 

• Injection 

• Voltage, current, and power 

• Capillary temperature 

• Pressure 

• Inlet and outlet vial change 

• .Alarm limit (minimum limit for electrical current ) 

• Polarity of voltage or current 

• Fraction collection. 

For the detector, the following parameters are programmable 
as functions of time: 

• Detector signals (defined below) 

• Threshold and peak width 

• Spectrum (permanent, all in peak, at up slope, peak 
maximum, and down slope, peak maximum, and baseline). 
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A feature of this software package is its simulation capabili- 
ties. It checks to see if the setup of a method to analyze a 
sample is in a logical sequence and if there are conflicting 
analysis steps such as. for example, a particular vial is needed 
at the inlet and millet ends of the capillary simultaneously. 
When a simulation is started the graphical user interface 
reacts as it does during an actual run. allowing the user to 
follow and check online how the instrument will react in 
reality. Especially for complex methods, this feature helps 
prevent time-consuming correction steps and spillage or 
waste of valuable samples through wrong parameter <>r time 
table settings. 

Different methods can be linked together to do a sequence 
of analyses. Several samples can be processed with the same 
method, or the same sample can be analyzed with different 
methods (different separation parameter settings), or a com- 
bination of both. Sequencing, together with the autosampler 
and the replenishment station, provides the instrument's 
automation capabilities. 

Data Collection. The system control software collects raw 
data during an analysis from the following channels: 
I'p to five detector signals (each signal includes wave- 
length, bandwidth, reference wavelength, and reference 
bandwidth) 

Spectrum (permanent, all in peak, al up slope, peak 

maximum, and down slope, peak maximum, and baseline) 

Voltage 

Current 

Power 

Capillary cassette temperature 
Pressure during run. 

The first two items in this list are normally used to do the 
standard data analysis. For the detector signals, peak w idth 
and rise time are selectable according to the particular ap- 
plication. The last five data channels in the list serve the 
purposes of interpretation and documentation. In case of 
any unexpected results, this data can he used to localize and 
diagnose a particular problem with the instrument, the 
application, or the sample. 

Data Analysis. W hen a method or sequence has been com- 
pleted and the data is successfully stored on the PC, data 
evaluation can he performed hy applying different algo- 
rithms. The information most relevant for the user consists 
of migration time, peak area, and peak height. When cali- 
brated, the peak area represents a certain amount of sample. 
To determine the peak area, the detector signal is integrated 
by a built-in integration algorithm. Reproducibility evalua- 
tion of repetitive analysis with the same sample is often 
used to increase the reliability of the results. Besides inte- 
gration, there are also built-in calibration and report genera- 
lion functions. Calibration determines the unknown amount 
of a constituent of a known sample by calibrating with a 
predetermined concentration. Report generation provides 
different report style options including automatic spectral 
library searches 

One of the most powerful features of the system is its spec - 
tral capabilities. Spectra are measured using the diode array 
detector and stored as selected. The tools associated with 



spectra in the data analysis software are generally used to 
identify unknown Compounds, The tools are: 

• Spectral library' Allows a library search of selected spectra 
from a separation regardless of whether they are generated 
during an LC or a CE separation. 

• Peak purity. Compares the ratio of two signals or spectra 
along the peak. If there is any deviation along the peak there 
is a probability of an overlay of two compounds. 

• Isoabsorbance plot. This is for qualitative evaluation of 
spectral data. It can be used to generate a new electropher- 
ogram by extracting signals from spectral data, to find the 
optimum wavelength for detection of each component, and 
to average spectra to reduce noise. 

Since identification by absorption spectra is a well-established 
tool in LC. many of the compounds analyzed with CE can be 
identified by available spectral libraries created with LC. 
The library shipped with the IIP CE ChemStation software is 
identical to the library shipped with our LC ChemStation. 
This makes using the data analysis software more conve- 
nient for customers who already have experience with our 
LC ChemStation. 

Summary 

The HP CE instrument is the technical and technological 
implementation of the objectives stated for the project as 
well as for the product. Most of the requirements were im- 
plemented and can be reflected in a corresponding cus- 
tomer need. Significant improvements in detection sensitiv- 
ity were made by the special detector design and even more 
by the extended lightpath capillary. The totally new liquid 
handling concept delivers significant automation features 
and versatility for future applications. The newly designed 
injection system provides further system reproducibility 
while the new forced-air-cooled cassette is a major step for- 
ward in terms of usability and flexibility. Another major ad- 
vance for this type of instrumentation is the graphical user 
interface built into the IIP ChemStation for instrument con- 
trol. Finally, the electronic components and firmware devel- 
oped for this product (discussed in the article on page :l(>) 
make this a functional product. 
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Industrial Design of the HP CE Instrument 



It is not always recognized, and consequently not acted upon, that the contents and 
signilicance of industrial design f0> the success of pioducts and the image ol the 
company have changed in the past tew years Products have not only a technical, 
but also an aesthetic lunction Together with some other representative features, 
such as advertising, company buildings, letterheads, packaging, exhibition booths, 
and the like, product design determines a ma|or part ot a company's image I 
Today, products must not only be reliable, efficient and user-ftiendly. but also look 
like it. Visible quality tuday is the mam attractor in many cases In particular, the 
leveling out and standardization of technical achievements even on the highest 
levels, lead to outward appearance being the decisive factor in the purchasing 
decision process more and more frequently last but not least, products, which 
also represent the company concept, have tn be in line with the identity nf the 
company Thus, what is impurtanl is nut avant-garde industrial design, but the 
successful combinatiun of innuvalive and traditional elements. 

Industrial design, therefore, is a part of product quality Whethei we thereby 
achieve the improvement of quality ot use or acceptance among a specific target 
group, 01 capitalize on the identity of the company, proper industrial design is a sales 
promoting product leature This applies not only to cnnsumer products but also to 
commercial products Very often, the lirst look at something determines whether 
we continue dealing with it or leave il alone The quality ol product design should 
make product quality the locus of customer interest right at lirst sight 

Internal Architecture 

lhe first step towards good industrial design consists in laying oui the components 
inside the instrument As early as the investigation phase of the HP CE instrument 
protect, the engineers were prompted to think about the dimensions and forms of 
the components they were responsible for Rough details were then used tu create 
all components hum cardboard in duplicate In a joint creative session, the entire 
project team used the models lo arrange lhe components in multiple ways, finally 
deciding on one alternative Understanding tor each other's problems was gained 
within lhe team at a very early project stage airflow and thermal problems, safety 
concerns, cooling, ease of use for service staff and users (which the industrial 
designer is also responsible lor), and the like This process not only led lo the 
project being faster and more locused, but also had a teambuilding character 



t Image means the company as peiceived by its customers Identity means the company as il 
really is Ideally, imaije = identity 



The immediate effects of the internal layout on the user interfaces become obvious 
in the vials, buttles, and cassette, which can be exchanged easily and intuitively 
Tins ease af use is supported by the design of the instrument exterior, which 
visually reduces complexity 

As the project proceeded, a model of the outside cover was built (see Fig 11 The 
visibility ol the product in the form of the model further enhanced identification 
witfi the project, even beyond project team borders 

Appearance 

Industrial design is not entirely up to the industrial designer Carefully halancing 
innovative design with company-specific design within the sense of the corporate 
identity on the one hand, and on the other hand, emphasizing product-specific 
features tn the best advantage, benefit both the product and the company 

The outward appearance of the HP CE instrument is designed to achieve a number 
of objectives 

i Emphasizing system character with a view to the HP PC. since the HP instrument 
is controlled by a PC II the outward appearance ol these Iwo components is 
harmonized, it not only suggests that they come trom the same company, but much 
mure important, that they easily communicate with one another In our case, this is 
achieved by equal use of volumes and forms as well as by HP identity elements such 
as coloring (bottom dark grey, top; light), radii, HP narneplate. and power switch 
(see Fig 1) 

i Emphasizing system character with a view to HP analytical systems. The HP CE 
instrument is often to be found side by side with other HP analytical instruments 
in a lab or as part of an analytical system II lhe outward features of our analytical 
instruments ate in harmony with one another, this suggests to the customer that a 
complete solution to a problem is available from one source In the case of the HP 
CE instrument, this is achieved by using, in addition to the design elements already 
mentioned. HP Analytical Producls Group typical design ot user elements such as, 
for example, the baseplate image, the semicircular pushbuttons set off by color- 
ing, equal textures, equally colored windows, doors always opening in the same 
direction, equal status LEDs, equal fonts, and the like The constant repetition ot 
these visual and functional characteristics of the user interfaces makes a maior 
contribution to ease of use by recognition The particular challenge is always to 
hnd new solutions lot new requirements that are technologically feasible but also 
continue the HP design tradition, so the customer finds it easy to get along and 
immediately accepts the solution as an evolutionary step 
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Fig. 1. Industrial design leatutes ol the HP 
C£ instrument 
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• The .noivKluai character of the HP CE instrument is emphasized by the taste in- 
strument volume as well as by the visibility and torn of some specific areas The 
window parts show the areas relevant to the customer (cassette, sample tray, arc! 
replenishment bottles) Like these parts, the tray balcony, for example, is designed 
m such a way that it facilitates function (access to vials) on the one hand, while at 
the same time charactering the look of the instrument dearly and unmistakably 
land also optically reducing instrument depth I Emphasizing the vertical lines of 
the instrument optically supports the narrowness of the instrument 

• What is also particularly important ; the visual expression of quality. Especially at 
a time when some instruments show only slight technological differences, cus- 
tomers should be convinced of the quality of our instruments at first sight By 
using the tight materials and manufacturing processes, we have attempted to 
distinguish our products qualitatively from those of our competitors, so that work- 
manship and finish provide our instrument with a highly professional appearance 

At the International iF Design Competition 1991. the HP CE instrument was awarded 
a prize for its good design and was seen by more than one million visitors in a 
special exhibition at the Hannover Fair and Cebit 
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A High-Sensitivity Diode Array 
Detector for On-Column Detection in 
Capillary Electrophoresis 

The small peak volumes in CE demand special optical design to maximize 
sensitivity High light throughput, good stray light suppression, and precise 
alignment are necessary. The diode array detector design focused on good 
matching of the illumination system and the spectrometer, precise 
alignment of the capillary and optical elements, and mechanical and 
thermal stability. 

by Patrick Kaltenbach 



I'ltraviolel (I'V) and ultraviolet/visible (l'VA : is) absorbance 

detection currently is the most commonly used detection 
technique in capillary electrophoresis (CE); The universal 
nature of this detection principle, its widespread use in high- 
performance liquid chromatography (Hl'LC). and its rela- 
tively simple adaption for on-colnmn detection are some of 
the reasons for its popularity. 

I "sing a diode array detector, absorption at a large number of 
wavelengths can be measured simultaneously, Riving spec- 
tral information. Thus the area of application can be further 
enlarged. Since the observed spectrum is characteristic for 
any analyte. Mils information can he used l"i Identification 
of unknown compounds. Multiwavelength detection, peak 
Identification, and peak purity determination are capabilities 
that make the diode array detector a powerful tool and an 
ideal detector for CE. 



The small peak volumes in CE demand special optical design 
lo maximize sensitivity. High light throughput, good stray 
light suppression, and precise alignment of the small capillary 
are necessary to gel the best possible performance. 

Optical System 

Fig. 1 shows a schematic overview of I he optical system of 
the IIP GE diode array detector A new type of prealigned 
deuterium lamp is used lo increase Ihe overall light 
throughput and thus improve the sensitivity of Ihe system. 
This type of lamp has a much smaller emission spol than 
lamps prev iously used for 1IPLC. making il superior for 
illumination of small sample areas. The polychromatic light 
of the lamp is focused onto Ihe detection window of the 
capillary by an achromatic lens system. These detection 
windows are usually made by removing a small seelion of 



Fused Silica 
Capillary 




Fig. {. Stihomatii overview of the 
CE diode array detector optics 



20 .li 1896 llowioii I'm kanl.lounml 

©Copr. 1949-1998 Hewlett-Packard Co. 



Wavelength calibration 



LunerKly it 10m 

190nm ! 1. 1)11 i 



Do* 'll^^BdU An* 

Should be 0.5 nm 

an 



Cml.al.onh 


titorr 


20 07 94 






gQl4 02l5 


1 0 m"" 






20 0794 






10 30 40 


2607 94 


• -: m 




^074906 


270794 


ttSnaj | 




'I'I'li; m M 


270794 


Reset history 





OK 



Cancel 



Help 



F\g. 2. Wavelength calibration 
wiiii low. 



the polyimide coaling of I he fused silica capillaries. A slit 
behind the capillary blocks stray light and defines the 
entrance slit of the spectrometer. The shutter is used to cut 
off radiation for dark current compensation or to drive a 
holmiuni oxide filter into the optical path for wavelength 
calibration purposes. The spectrometer consists of a 
holographic concave grating which disperses the light onto 
a photodiode array. 205 diodes are used for a wavelength 
range from UK) to 600 nm. which gives a resolution of 2 nm 
per diode. Grating, array, and signal electronics are very 
much the same as for the HP 61306A diode array detector 
and the IIP 798f>4A multi wavelength detector for IIPL< !, 1 

To Optimize the overall performance of the system, the de- 
sign focused on good matching of the illumination system 
and Hie spectrometer, precise alignmenl of the capillary and 
Optical elements, and mechanical and thermal Stability. The 
Optics bench is precision machined and exchangeable parts 
such ;ls the lamp or the alignment interface (slil ) are sell- 
aligning. To maintain optical precision, the system recog- 
nizes when the user accesses these exchangeable parts, A 
wavelength calibration is performed every lime Hie Instru- 
ment senses a possible change and if necessary die user is 
asked to confirm new calibration sellings (Fig. 2). 

Since the spectrometer f-mimber of I represents the basic 
liiuil On the light thrOUgbpUl of the system, the lamp anil 



lenses are designed to match this limitation to optimize the 
overall light throughput. 

Ray tracing software was used to calculate aberrations, lo 
determine theoretical optimums for positioning of the opti- 
cal elements, and to maximize light throughput. Fig. 3 shows 
a ray tracing plot of the optical system, and Fig. 4 shows in 
detail a ray trace through a capillary with 150-um inside di- 
ameter — for example, a 50-um capillary with an extended 
lighipath With BF = •'! ( BF = bubble factor, the increase in 
the diameter of the capillary at the detection window of Hie 
detector, as explained in the article on page G2). 

Theory 

On-column detection approaches often use setups similar lo 
that shown in Fig. 5. In a small area near the outlet the capil- 
lary is illuminated with light from a CVA'is light source, and 
a slil of width o is placed behind the capillary lo block stray 
light through the capillary wall. The light bansmitted 
through the slii is detected. 1'sing the Lambert-Beet law, (he 

detector signal for an ideal cell is determined by; 

AO.) = e(/.)CD = log— j. 

where A(/.) = absorbance in absoi bance units ( Al ' ) as a 
function of wavelength. e(>.) = extinclion or molar absorption 
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Fig. 4. Ray trace <>f lUfi. 25-1, ami (iiiri nni thnmgh a water-filled eap- 
illary. 



coefficient as a function of wavelength, C = molar solute 
concentration, D = path length. In = incident photon flux, 
and I = transmitted photon flux. 

If stray light passing Ihrongh Ihe column wall can reach the 
detector, the equation has to he rewrilten: 

A=lo «TTiv 

where Is = stray lighl through Ihe capillary wall. 

A typical detector response is shown in Fig. (>. The lower 
limil of detection is determined by the baseline noise of Ihe 
detector and ils sensitivity, which can be described by Ihe 
slope dA/dC of Ihe detector response. The upper limit of 
detection is determined by the nonlineariiy of Ihe detector 
response al higher concenlralion levels. I 'nwanted stray 
light causes a deviation of the response from Ihe iheoreiical 
linear slope according to the Lambert-Beer law. The steep- 
ness of the slope, in contrasl to typical 1 1 PLC delect ion 
cells, is dependent on the effective path length (related to 
the inside diameter of ihe capillary ) and the Stray lighl 



through Ihe capillary wall. As a result, there is a linear range 
in which the detector can be operated lo gel reliable results. 

Sensitivity, Noise, and Linear Dynamic Range 

This section discusses the parameters that influence the 
performance Ofthe diode array detectoi and Ihe trade-offs 
that have lo be made lo optimize Ihe system. 

A big disadvantage of the on-column detection approach is 
Ihe possibility of light passing through Ihe transparent capil- 
lary wall without interacting with the sample. Figs. I and 5 
show clearly I hat not all rays propagate through the center 
of Ihe circular cross section ofthe capillary. This decreases 
the linearity of the detector and reduces the effective path 
length, which determines the sensilivily of Ihe detector. To 
maximize Ihe response (effective path length) and linearity 
ofthe detector, the width o ofthe slit must be as small as 
possible. 

Since the slil defines the entrance aperture of Ihe spectrom- 
eter, the slit width o has an unpad on the optical bandwidth. 
A liO-Lim slil width corresponds to a 2-nm optical bandwidth 
ofthe CE diode array detector. 

At the lower limil of deled ion. baseline noise becomes im- 
portant. As long as the baseline noise of Ihe signal is limited 
toSchottky noise (noise associated with the pholocurrent 
generated by Ihe photodiodes), the baseline noise is depen- 
dent (jii Ihe total light throughput reaching ihe detector and 
is inversely proportional lo Ihe square root of ihe lighl 
throughput (pholocurrent): 

_ (i v /2ql, )h BW 
" 2.31,,,, ' 

where Ig m = peak-lo-peak value of ihe Schollky noise cur- 
rent, q = charge of Ihe electron. = photometric signal 
(Current ). and BW = electrical bandwidth. 



Flow 




Fig. 5. Slil and capillary in an im- 



Cross Section View COlUilUI detection approach 
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Concentration 

Fig. 6. Diode array detec tor response characteristic. 



Expanding the slit, therefore, will decrease the baseline 
noise. Thus the optimum slit width o is a trade-off between 
light throughput (noise), linearity, sensitivity, and spectral 
resolution. An Important attribute for detector performance 
is the linear dynamic range, calculated as: 



Linear Dynamic Range = 



Upper Limit of Detection (AUj 
3 x Noise (AU) ' 



where the upper limit of detection is given by the point 
where the detector response deviates 1% from the expected 
linear response (see Fig. (i). 

Different capillary inside diameters are used in C'E (typically 
25 urn to 75 um). For optimum performance the slit size 
must be well-matched to the inside diameter. Using the right 
slits, a high linear dynamic range can lie achieved for start 
dard capillaries and even further improved using exlended 
lightpath capillaries (Fig. 7). 



The slit height I along the separation axis has an influence 
on the resolution (peak width) and peak height of a detected 
peak- It also has an impact on the light throughput and in- 
fluences the baseline noise as already mentioned To mini- 
mize the impact of the detector on the efficiency of the sepa- 
ration the slit heigltt should be as small as possible. Fig. S 
shows the theoretical distortion of a Gaussian peak detected 
through a rectangular slit. For simplification, the mathemati- 
cal model neglects the separation (mobility ) of the analyte 
(peak) in the detection window. The deformation is given by. 



Signal Deformation = 



Observed Signal 
True Signal 



where the observed signal is the detector output using a slit 
with height I, and the true signal is the detector output using 
an infinitely small slit. 

Longer slits result in a loss of resolution ( broader peaks ) and 
decreased peak height of the recorded signal. However, as 
long as the slit is small enough compared to the peak width, 
slightly longer slits do not significantly degrade resolution 
and they improve the signal-to-noise ratio by allowing more 
light to reach the photodiodes. As a rule of thumb, the slit 
height should be smaller than the parameter oof the detected 
peak, where the Gaussian peak shape can be described by 
the formula: 

i ,x ~f'~ 
f(x) = — i=e 
Oi2jt 

Peak Width = ,5.54 a (full width at half maximum). 

HP offers a variety of capillary lengths and inside diameters 
to cover the needs of a wide range of applications. Three 
standard inside diameters are available at the moment: 25, 
50, and 75 tint. The 50-|itn mid 75-uni capillaries are offered 
with and without exlended lightpaths (bubbles), whereas 
the 25-um capillaries are only offered with a five times ex- 
panded inside diameter at the detection point (BF = 5). 




25 |im BF5 50 |im 50nmBF3 75|cm 75 |im BF3 
Capillary Type 



Fig. 7. Typical values for the linear dynamic range using different 
capillar? inside diameters. 131" = bubble factor, the increase In the 
diameter of the capillary at (In detection window of the detector 
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Fig. s. Signal deformation by increasing the slit Keighi 
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Fir. o. Comparison of caffeine 
spectra acquired by («) < 'K and 

(li) HI'LC ((•) <)Vf|-ln> of rnffelne 

spectra from GE and HPLG runs. 
ck conditions: buffer = 1 1 7 mil 

borate. HM niM phosphate. 5(1 niM 
si>K.plls.!i; Sample = acetami- 
nophen, caffeine, naproxen guai- 
fenesin, phenaeetln, rtosoaplne; 
capillary bd.=5QiMTti L«ipS6cri: 
Injection pressure/Ume produci = 
6pmbar-s;B=370V/cm:T = 
WO. detection wavelengih/band- 
width =200/16 run. LCcondl 
lions Hypersil < >l IS column. 
11111x2.1 mm, 5-pm particle size: T 

= IH'C; 1 1 1< iljila ■ | ilm.se - water' 

aeetonitrile (SSflS) at 0.4 truVmrn; 
In ng caffeine on column: detec- 
tion vvavelenglli/banilvvidlh = 
254/4 nmi SBt width = 2 urn 



Table 1 shows the dimensions ol" the slits thai are offered for 
each capillary type. The minimum useful signal bandwidth 
indicates the related optical bandwidth. 

Table I 

Capillary Inside Diameters and Slit Dimensions 

Capillary Inside Slit Dimensions Minimum Useful 
Diameter (oxl) Signal Bandwidth 



25 pan, BP = "> 120*80 pan 

BO tint 40x620 urn 

50 uni. BF = 3 145x145 uni 

75 urn 55x020 urn 

75 uni, BF = 3 200x150 uni 



1 nin 

2 ran 
5 ran 
2 run 
7 run 



BF ■ Bubble laclw the increase m the diameter ol the capillary at the detection window ol the 
detector 

Spectral Quality 

Capillary electrophoresis is becoming more and more im- 
portant as an orthogonal technique to HI'LC. The use of 
spectral libraries for peak Identification, using spectra taken 
in HI'LC, can be v ery helpful. 

However, the optical design of the CE diode array detector 
must ensure that no distortion occurs because of different 



effective path lengths for different wavelengths. The ray 
trace in Fig. J indicates that rays of different wavelengths 
may travel different paths through the cell resulting in differ- 
ent effective path lengths. Special care has to be taken to 
minimize distortion; otherwise, spectra will differ from 
those taken with an HPI> ' system. 

As an example, Fig. 9 compares the spectrum of caffeine 
acquired with a 50-pm standard capillary on the HPGE 
diode arraj detector with thai obtained from an HPLC sys- 
tem equipped With a 2-nm slit. The match is its good as typi- 
cal matches obtained on the same instrument with 
repetitive analysis. -' 
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Capillary Handling in the HP Capillary 
Electrophoresis Instrument 

Capillaries are encased in cassettes for easy replacement and connections 
are made automatically when a cassette is installed. Air cooling of the 
capillary eliminates leak problems and lowers costs. Vials containing 
samples and electrolyte are automatically lifted from a tray to either end 
of the capillary. 

by Hans-Peter Zinunermann 



As the name capillary electrophoresis (CE> indicates* I he 
separation capillary is a fundamental element of a CE Instru- 
ment Depending on the application, different types of capil- 
laries are used. Capillaries can differ in length ( from 25 cm 
to It Kl cm |. internal diameter (2- r > urn to [SO (lift), or coating 
of the inner walls. Tims the user must have the ability to 
exchange the capillary easily and quickly. 

In the MP CE instrument, this ability is provided by a capil- 
lary cartridge system. The capillaty is encased in a cassette. 
By keeping several cassettes on hand, each with a different 
type of capillary, the user can exchange the capillary in the 
instrument and be ready for a different application within a 
few seconds. The cartridge system makes it possible to 
Change the capillary in the cassette in a few minutes should 
the capillary be blocked or break, or should its surface be 
deactivated. Fig. I shows the cassette setup. 

Using the Cassette 

The cassette is sealed with a quick lock mechanism. The 
user only needs a rollerball pen to open the cassette 
(Fig. la). The capillary is threaded through the detector 
interface (Fig. lb), which later, upon placement of the 
cassette, adjusts the capillary to the detector. The capillary 



can now be Utsetted in the cassette and reeled up on the 
mandrel. A clamp mechanism fixes the inlet capillary end in 
the cassette. The two feet of the cassette facilitate aligning 
both capillary ends to the same length while at the same 
time protecting them. When needed, the cassette is inserted 
into the holding fixture provided in the instrument and 
tipped back. Fig. 2 shows the cassette location in the 
instrument. 

When the user inserts the cassette into lite instrument, the 
following interfaces are established automatically: 
To I he high-voltage pow er supply for generating the electric 
held within the capillary 

To the sample and electrolyte handling system (liquid han- 
dling system) to provide the capillary with sample and 
electrolyte for automatic operation 
To the pressure system to be able to push liquid into the 
capillary for injection or flushing purposes 
To the detector for measuring the absorption of the 
substances separated in the capillary 
To the capillary cooling system for thermostatically 
controlling the separation capillary temperature. 

Connection to the High-Voltage Power Supply, Pressure System, 
and Liquid Handling System. I 'pon insert inn of the cassette, 
the capillary ends are automatically threaded through the 
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Fig. 2. Inserting the capillary cassette. 



two electrodes located in the instrument. The electrodes 
establish the links to the high-voltage power supply, the 
pressure system and the liquid handling system. 

Fig. 3 shows the setup of an electrode. The funnel threads 
the papillary through the silicone rubber seal, the housing, 
and then through the platinum tube electrode. This elec- 
trode is connected to the high-voltage power supply and 
makes the electrical connection to the two electrolyte vials 
during analysis to apply the electric field for separation to 
the capillary. To avoid corrosion of the electrodes caused by 
the electric field and corrosive buffers, the electrode tubes 
are made of platinum, which has extreme chemical stability. 
For sample analysis, vials containing the sample or the elec- 
trolyte buffer are lifted up to I he two electrodes so that the 
capillary end and Che enclosing platinum tube dip into the 
liquid. 

To Hush the capillary or to inject sample, it is necessary to 
seal the separation capillary against the vial, so that pres- 
sure can be applied inside the vial. If the lid of the instru- 
ment is closed, a spring-loaded pin inside the lid presses the 
cassette down on the electrodes. This compresses the sili- 
cone rubber plug inside the electrode housing so that the 
capillary is sealed against the electrode. During Hushing, a 
vial is scaled in die cone at the bottom of the electrode 




Fig. 3. Electrode details. 
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housing so that the pressure inside the \ials presses liquid 
into the capillary. 

Connection to the Diode Array Detector. When the capillary is 
threaded through the detector interface, it is aligned radially 
by a V-shaped slot to the slit in the detector interface, which 
shades the capillary and leaves only I he detection window 
open. The correct axial position of the capillary relative to 
the slit is achieved by a small stopper affixed to the capil- 
lary. The size of the slit depends on the internal diameter of 
die capillary, so different detector interlaces must be used 
for the different capillary types. The correct choice of inlet - 
face for each type of capillary is indicaled by a color code. 

The detector interface floats in the cassette with a clearance 
of + 1 mm. When the cassette is tipped back, the detector 
interface is automatically adjusted lo I he detection slit by a 
capture funnel (see Fig. 4). 

Connection to the Capillary Cooling System. For cooling and 
temperature control of the separation capillary, ail" is blown 
into the capillary cassette al high speed. The capillary cooling 
system is located in the upper back part of I he instrument 
(see Fig. 2). When the lid is closed, air ducts in die lid auto- 
matically link lite cooling system lo the cassette. The funclion 
of the capillary cooling system is described in more detail in 
the next section. 

Capillary Cooling System 

Depending on the applied field strength and conductivity of 
the buffer located in the Capillary, there is an energy through- 
pul of up to OW in ihe capillary during analysis. If the capil- 
lary were cooled only by nalnral convection, Ihe liquid core 
in die capillary would rise lo more I ban si) ( ' above room 
temperature in a 1-m capillary at maximum power. This might 
cause destruction of sensitive samples or even boiling of Ihe 
buffer. Fig. 5 shows the setup anil Ihe different Capillary and 
fluid temperatures T,., Ti, T 2 , T 3 , and T f . 

The temperatures in die capillary can be calculated accord- 
ing tO Newton's Law: For the temperature difference in the 
core, die following is li ne: 1 



Mi 



k s r| k,, r> 



(1) 



u here Pi, and 1. are the dimensions of (he capillary 
i see Fig. 5), k|„ k s , and 1< , . are the thermal conductivities of 



the buffer, Ihe quartz wall, and the polymer coating, and P is 
the power level inside the capillary. 

I 'sing typical substance values and measures, equation 1 
predicts a temperature difference between die core and the 
outside of the capillary of about 2.0 degrees with a power of 
4 .-"iW and a 1-m capillary length. The temperature grailieni 
within the capillary only plays a minor part. The main con- 
tributor lo the temperature rise in the core is the heat trans- 
fer to the ambient ah" at the capillary outer surface. This 
temperature difference can be calculated according to the 
following equal ion: 1 



AT = T :t - Tr = 



2.iLr ,h ' 



where h is the heat transfer coefficient at the capillary 
surface. 

Unfortunately, the temperature drop at the capillary surface 
is not as easily calculated as equation 2 suggests, since the 
heat transfer coefficient h has a nonlinear dependence on 
the flow velocity and the temperature of Ihe surrounding 
coolant. Fig. 6 shows the temperature rise in the core (T,.-Tf) 
as a function of flow velocity for air and for a typical cooling 
liquid ( fluorocarbon PG77 from 3M ) with a power dissipation 

of 4.5 W/m in the capillary. 

Fig. (J shows that when cooling the capillary with forced air, 
above ;i How Velocity of about 10 m/s, improvements in cool- 
ing performance cannot be achieved. For liquid cooling, the 
temperature rise inside the capillary is about 3.6 times lower 
than for air cooling at equal velocity, ac t (.riling to equation 2. 
Flow velocities as high as with air. however, can hardly be 
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Fig. 5. Temperatures and radii of fused silica capillaries. 
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Rapid Prototyping for the HP CE Project 



In the past few vears, methods offering the possibility of liansforming 3D CAD 
data directly into a ready to mstall part have experienced a steep upturn These 
methods, which have been commercially available for about ten years now, are 
generally known under the catchword "rapid prototyping " Some of these methods 
and their combination with different replication techniques have reached the real 
aim of rapid prototyping, namely the reduction of lime to market. Within the HP 
capillary electrophoresis ICE) project, rapid prototyping methods became indis- 
pensable, not only because of the ambitious project schedule, but also because of 
the fact that some parts, because of their complexity, could not have been pro- 
duced in the traditional way without substantial compromises 

At the Waldbronn Analytical Division, these methods were used for the first lime, 
involving significant risk because none of the people concerned could rely on per- 
sonal experience. Another reason for using rapid prototyping methods certainly 
was the cost aspect However, it proved necessary tu balance the requirements of 
the individual development steps, the time available, and the complexity of the 
individual parts against one another In accordance with pan requirements, three 




Fig. 1. STL lile created with a CAD application 
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methods were pursued in the HP CE project, two ways to get a resin-plastic part 
and a Ihird method to get an alumina part 

• 3D data -* stereolithography process -» vacuum casting — plastic model 

• 3D data Solider process -» vacuum casting -» plastic model 

• 3D data -» STL file (Fig 1 1 -* stereolithography process -»STL model (Fig 21 -» 
vacuum casting with silicone -* wax model (Fig. 31 -*ceramic shell for 
traditional investment casting for alumina parts (Fig 4) 

The real rapid prototyping step results in directly translating the 3D construction 
data into a solid part The principle of all iliree methods mentioned above is simi- 
lar a 3D computer model is split into layers of a certain thickness by software 

Various methods are applied to copy the section in question to materials such 
as photopolymers or powdery thermoplastics hy using differeni reproduction 
techniques. This procedure is repeated until the whole part, composed of hun- 
dreds of layers, is complete (see Fig. 5) 




Fig. 2. STL model 



realized with liquids. Al typical velocities of about 0.5 m/s 
with liquid cooling, the difference from high-speed forced-air 
cooling only is about o°C (8.8 C for air •3.9 C for liquid I with a 
4.5 W/in energy throughput in the capillary. The advantage 
of air cooling versus liquid cooling is that capillary handling 
is significantly easier for the user. When exchanging the cap- 
illary, no liquid has to be drained and no costly sealing of the 
cassette is needed With air as the coolant, low leakage has 
no disturbing influence. Also, no expensive cooling fluids 
are necessary, which lowers the cost of ownership. 

Because of these advantages of air cooling, we decided that 
an excess temperature of five degrees in the capillary core 
could be accepted. In the HP CE inslniment. forced-air Cap- 
illary cooling is used witJi air velocities of about 10 m/sat 
the capillary. 

Because the mobility of the substances in the capillary 
changes by about 2% per degree, another important require- 
ment of the cooling system is the ability to adjust the tem- 
perature of the cooling air with a precision of ±0.1 degrees 
to suppress variations in room temperature. This is achieved 
by a Peltier heat exchanger element regulated by three tem- 
perature sensors. This element makes it possible to adjust 
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Depending on the method applied, the 3D data has to be prepared in different ways 
le g., support hameworkl Regarding the actual formation of the part, however, 
each method has its process-specific advantages and disadvantages 

In qualification of these rapid prototyping methods however, ii must be pointed 
out that ihe parts cannot be used without costly subsequent treatment and repli- 
cation—preferably with silicone— if specific requirements on surface quality, 
accuracy and stability are to be met 

Martin Bauerle 
R&D Engineer 

Waldbronn Analytical Division 
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Fig. 5. The solid models are built up m layers 



the air temperature from ten degrees below ambient to 
(ill ( '. Fig. 7 shows the setup of the cooling system. 

A radial Mower draws airpasl the heat exchanger of ihe 
Peltier module and blows Ihe cooled 0T wanned air towards 
Ihe cassette through the air ducts in the lid. From there, the 
;iir is fed back to Ihe heal exchanger. The Peltier element is 
able tO deliver Up (O 5©W of cooling power and up tO tOOW Of 
heating power to the capillary cooling circuit. Because of Ihe 
relaiively low efficiency of a Peltier element, Ihere is a power 
dissipation of up to l- r >0Wai the heal sink of ihe Peltier mod- 
ule. To remove I his heal, the Ileal sink is forced-air cooled 
by an axial Ventilator Veiililalor, Pellier, heal exchanger, 
and driver electronics are located in Ihe cooling system, 
embedded in two isolating foam shells. 

Sample and Electrolyte Handling 

To achieve a high sample throughput in aCE Instrument, the 

supply of samples anil eleclrolyles lo thfi tWO capillary ends 



has to be automaled. In Ihe III'CK inslruinenl. litis task is 
performed by the liquid handling system show n in Fig. 8. 

Samples and electrolytes are in small vials of 2 nil or DJJ nil 
Volume in a circular tray ring. The Iray ring can accept a 
maximum of 1H vials. A heal exchanger in Ihe center of Ihe 
Iray ring can be connected to an external cooling bath for 
adjusting Ihe vial tempera! lire. The heal exchanger is an 
example of several pails of ihe HI' CK inslruinenl I hat were 
designed using rapid prototyping, as explained above. The 
tray ring rests on Ihree rollers al its perimeter and is driven 
h\ a servo motor via a pulle) 

Samples and elecirolytes in Ihe Iray have lo be positioned al 
both the Capillary inlel and the capillary outlet. Because the 
Iray ring inusl be free lo rotate, the vials must be lifted from 
the Iray lo the capillary ends. This task is performed by the 
lift modules. 'l\vo lift modules lift Ihe vials up to Ihe capil- 
lary ends, and a I bird lifl module moves vials lo a needle 
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Air Outlet to Cassette 



Fig. 7. 1 loafing system, 



through which conlaminaU'ci t'leclrolytc can be sucked off 
and vials can be refilled witli fresh electrolyte from a dis- 
penser liollle (see article, page -i2). 

This setup offers several advantages. First, il provides ran- 
dom access to all of I he vials in the autosampler. Each vial 
can be positioned either at the capillary inlet al the capillary 
outlet, or at the replenishment module. This means that the 
user can decide how much of the tray capacity to use for 



sample vials and how much for electrolyte vials. Second, 
changing vials at the capillary outlet allows the different 
fractions of a sample to lie collected separately. Third, this 
approach allows buffer replenishment and capillary pre- 
conditioning to proceed in parallel. 

To avoid sample ev aporation, the vials are sealed with caps 
whose thin membranes are punched upon injection. The 
sensitive ends of the separation capillary would break in this 
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Fig. 8. Liquid handling system. 
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Fig. 9. < "iiin'iiion Id Hit- inject inn system. 



process, so a punching needle is located in the lift head to 
prepunch the caps. In operation, the \ial is held by a kind of 
pliers and is pressed onto the punching needle by a spring 
before being lifted to the capillary. A ring-shaped blade seals 
the prepunch needle to the vial cap. The lift presses the cone 
of the prepunch needle against the seal at the electrode 
housing (the seal can be seen in Fig. 3), thereby providing 
the seal between the vial and the capillary. Pressure for 
flushing or injection can then be applied to the vial through 
a bore in the prepunch needle. The final position of the vial 
is shown in Fig. 9. 
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Sample Injection in HP CE 



For flushing or conditioning the capillary or injecting a sample, air 
pressures or different values and durations are applied. The injection 
system provides precise closed-loop control of the integral of the air 
pressure over time for either direction of fluid flow. The replenishment 
system automates the exchange of used electrolytes for fresh ones, using 
a special double-needle design. 

by Werner Schneider 



When analyzing samples with an elect rophoretic Instrument, 
there are limes when I lie liquid contents of the separation 
capillary have to be moved, such as Tor Hushing the capillary 
with different fluids for cleaning purposes, for conditioning 
it for another separation run. or for introducing sample in a 
qiumtifiable and reproducible manner. In the HP CE instru- 
ment, these tasks are performed by applying air pressures of 
different values and durations. How this is done is the subject 
of the firs! pan of this article. 

The second part of this article describes the replenishment 
system. During a separation run. the chemical properties of 
I he working electrolytes change as a result of electrochemi- 
cal reactions. This is typically not a problem for a single run, 
but for multiple runs the nin-to-run stability or repeatability 
will be lost. The replenishment system provides I he user with 
an automatable function for exchanging the used electrolytes 
with fresh ones. 

Overview 

Fig. 1 shows a schematic diagram of the functions mentioned 
above. The pressure source provides working pressures. 
The EMI board handles the output of the four pressure sen- 
sors (indicated by the arrows oul of the other blocks) and 
drives the solenoid valves (the two, three, or four arrows 
shown going into the other blocks). For more details about 
the relationship of these functions to the other functional 



areas of the instrument, especially to the system control, see 
the article on page 

Pressure Source 

Flushing, injection, and replenishment are driven by gas 
pressure. To avoid the need for external gas supplies, the 
pressure source is built into the instrument. It consists of a 
small dual-acting membrane pump, two valves (intake and 
outlet ), an intake ail' filter, and two pressure sensors (for 
pressure and vacuum). Dual-acting means that the pump 
provides both overpressure (+p. around 930 hectopascals or 
millibars) and vacuum (-p. around 120 mbar below ambi- 
ent ). The outputs of the valves are connected to the two 
large bottles, which Serve as pressure "capacitors" and as 
containers for the fresh electrolyte anil the waste. Thus the 
containers are also parts of the replenishment system. The 
linn ware controls the pressure values with two-point 
closed-loop control, with only one of the two valves active 
at a lime. 

Flushing and Injection 

Driving a liquid through a lube is in general fairly straight- 
forward: immerse I hi' ends of the tube in liquid, apply a 
pressure at the inlet end. and you gel a flow. According to 
the Ilagen-Poiseuille law, the flow rate is proportional to the 
pressure and to the fourth power of the internal diameter of 




Fig. 1. 1 (verview of thi injection 
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the tube, and inversely proportional to the length of the tube 
and the viscosity of the liquid. 

Flushing a capillary means applying a relatively high pressure 
to achieve acceptably high flow rates. As a rule of thumb, at 
least three to five times the liquid contents Of the capillary 
have to Ire pumped through to achieve a thorough flush. A 
typical flush time is two minutes foi a capillary with a 50-fim 
inside diameter and a length of 48.5 cm. 

Injecting a sample means applying pressure and driving the 
liquid into the capillary Here only small amounts of liquid 
are brought into the capillary, and the repeatability of the 
sample volume imisi be high. The mn-to-nin variation must 
be in the range of 3% or better. 

Small amounts of liquid means 1% to 2% of the capillary vol- 
ume (or. in more common CE terms, 1% to 2% of the capillary 
length), Since all the factors of the Hagen-Poiseuille law can 
be considered constant in Che short term, the flow rate is 
directly proportional to the pressure difference across the 
capillary. This means that the integral of the pressure over 
time is an acceptably precise measure for the amoiuit of 
liquid forced into the capillary. Since the user wants lo se- 
lecl i he injection amount as a parameler Of the method, the 

insiniinent needs to generate the time integral of the pres- 
sure. For example, with a "lO-ttm inside diameter. 48.5-cm- 
long capillary, a pressure of 1(1 mbar for 4.6 s achieves a 
sample plug approximately 3 mm long. 

Fig. 2 shows (he schematic diagram of the injection and 
flushing system, together with a view of the inlet lift holding 
a sample vial. The lift is pail of the liquid handling system 
described in (lie article on page 25. Valve 1 and valve 2 deliver 
air flows for injection, and valve :l is for Hushing. Valve I is 
USed fbl controlling Hie venling port. Venting is active during 

ail movements of the components to avoid the buildup of 



any spurious pressures. For example, some compression 
takes place when the O-ring between the lift head and the 
electrode holder has begun tO seal but has not yet reached 
its final sealing position. 

Flushing. Hashing is straightforward. After the vial is fetched 
and brought to the scaling position, both valve 3 and valve 4 
are activated. Valve 3 directly connects the vial lo the sys- 
tem pressure *p. pushing the liquid into the capillary When 
the user-defined time has elapsed, both valves are switched 
off again, and the lift he.nl is released from the sealing posi- 
tion to its default height for the analysis run. 

Injection. As indicated above, injection requires much 
smaller pressures than flushing. For avoiding detrimental 
effects like splashing, the pressure is not applied instanta- 
neously but in a smooth maimer. The manifold thai carries 
the s alves also has an internal chamber. When switching 
valve 1 on. for example, air from +p flows through restric- 
tion 1 into this chamber. With the sample vial in the sealing 
pi isiiion and valve 4 activated, the air flow causes a rise in 
the pressure in this closed system (phase 1 in Fig. 3). which 
is measured by the injection pressure sensor. This is analo- 
gous to an electrical resistor-capacitor arrangement, that is. 
the pressure lise follows an exponential curve. Since the 
maximum value of 50 mbar is small compared to that ofthe 
pressure source, the rise is almost linear. The same mecha- 
nism is applied to generate the downslope. Through valve 2 
and r estriction 2. the closed system is connected to -p. thus 
drawing the air out ofthe closed system (phase 2 in Fig. 3), 

The liming ofthe valves is controlled by a successive 
approximation algorithm implemented in the instrument 
firmware. Actively controlling both the upslope anil the 
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Fig. 3. Capillar} pleasure profile during sample Injection. 

downslope provides precise closed-loop conlrol of the inle- 
gral of I he pressure over lime, lis precision and reproduc- 
ibility are delemiiiied hy the timing resolution of the instru- 
ment's multitasking system and lite resolution and accuracy 
of the pressure sensor. The system totally compensates for 
the variations and tolerances of the other components, In- 
cluding the switching characteristics of the valves, the toler- 
ances of the restrictions, the temperature dependences of 
dimensions, and gas viscosities. 

The total area under tlie pressure curve In Fig. 'i represents 
approximately •">() nibar-s. Values down to 2(1 mbar s (this 
corresponds to a plug length of 0.:i mm) are achievable with 
less than tl.-'i"., variation. Hence the variations of the injec- 
tion scheme are significantly smaller than those caused by 
the so-called "zero injection effect" as described in the ar- 
ticle on page 50. 

Additional Features 

The bipolar' pressure source allows not only closed-loo)) 
conlrol Of the injection cycle, but also generation of a simi- 
lar curve with reversed sign, that is, the flow direction can 
be reversed. This is adv antageous for separations performed 
from the detection side of the capillary, such as fast screen- 
ing separations. 



By appropriate firmware conlrol. this scheme also allows 
the application of small pressures in the range of -50 mbar 
to +50 mbar. Like the oilier method parameters, this function 
is lime programmable and is available during the separation 
run. 

For separation methods like isoelectric focusing, where no 
electroosmolic How is present, external pressure is neces- 
sary for pushing Ihe separated species past the detector. 

Replenishment 

Repealed runs for every sample are mandatory for valid 
analysis results. Therefore, it is necessary to keep all the 
conditions and parameters thai influence the separation as 
stable as possible. In elect rophoretic analyses, the electro- 
osmolic flow is one of the major aspects, and is strongly 
influenced by Ihe pll value of Ihe run electrolyte. As a result 
of the voltage applied to perform the separation, electro- 
chemical by-products are generated. One of the effects is 
the decomposition of water. This leads to ihe generation of 
protons at Ihe positive electrode and hydroxide ions al the 
negative. More protons in a solution means that Ihe solution 
gets more acidic, and more hydroxide ions do the opposite. 
These changes directly influence Ihe electroosmotic How. In 
general, the electrolyte solution is buffered lo suppress this 
change, but altera number of separation runs, the buffer 
capacity is exhausted. In the III' GB instrument, one of the 
key features is automated, unattended operation, instead of 
using valuable vial positions in the instruments autosampler 
for a large number of run buffer vials, the replenishment 
system offers the ability to work with a minimum set of 
buffer vials, supplying fresh electrolyte into them. This pro- 
vides the user with the maximum number of positions for 
sample vials. 

The replenishment system is shown in Fig. 4. It consists of 
Ihe electrolyte reservoir, the waste container for holding Ihe 
used liquid, valve 2 for drawing Ihe used liquid out of the 
vial into the waste container, valve 1 for dispensing fresh 
electrolyte into the Vial, a measuring scheme for controlling 
the whole process, and a double needle for accessing the 
vial. 
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Fig. 4. Replenishment system. 



34 tune 10U3 I lewlett-Parkant Journal 

©Copr. 1949-1998 Hewlett-Packard Co. 



The double needle is provided by the replenishment lift arid 
serv es for emptying and filling the vial and as the probe for 
the measuring function. It c onsists of two pieces of stainless 
steel capillary which are welded together with an axial off- 
set of their orifices of five millimeters. The double needle is 
attached to the frame of the instrument- The lift moves the 
vial up and down and the double needle enters the vial 
through the prepunch needle in the lift head (see article, 
page 25). 

The measuring scheme uses the pressure sensor, the restric- 
tion, the measuring line of the double needle, and valve 3. It 
detects when liquid comes in contact with the orifice of the 
measuring line, that is. when the shorter end of the double 
needle touches the liquid surface. When the measuring sys- 
tem is activated by switching valve 3 on. a small flow of air 
is drawn through the measuring line and the restriction. Like 
a pair of electrical resistors, these two parts of the flow path 
act like a voltage divider. The ratio of the restriction values is 
approximately 1:15. With one end of the restriction connected 
to -p and the open end of the measuring line at ambient 
pressure, the connection point is at approximately -25 mbar. 
This value is measured by the pressure sensor. As soon as 
liquid touches the orifice, the air flow is interrupted. Thus, 
the pressure at the connection point is drawn towards -p. 
The control algorithm implemented in the instrument firm- 
ware interprets this change of the pressure value as I he sig- 
nal for "liquid detected." The related parameters, especially 
the air How and the internal volumes of the lines and the 
pressure sensor, are selected so that the delay between 
touching the liquid and issuing the signal is less t han 100 
milliseconds. 

The vial is filled and emptied through valve 1 and valve 2, 
which are connected lo the longer end of the double needle. 
Switching on valve 2 applies the vacuum. This is done be- 
fore the double needle is immersed in the liquid. The lift 
then slowly raises the vial while the liquid is drawn into the 
waste container. The free end of the double needle is tilled 



at a slight angle to avoid blocking the orifice when the bot- 
tom of the vial is reached. 

With valve 1 activated and valve 2 closed, liquid is dispensed 
into the vial, driven by the pressure in the electrolyte reser- 
voir. The filling height is selectable through the positioning 
function of the lift. It is determined by the sensing scheme 
described above and is user-programmable as part of the 
method for every vial independently. For the highest repeat- 
ability of the results, the user might replenish the electrolyte 
for every run. To keep the consumption of electrolyte low, 
the user might select the minimum filling level (the elec- 
trodes must be immersed during the rim). In separations 
that are chemically robust, the buffering capacity of highly 
filled vials might suffice for six to ten runs. 

When preparing the separation capillary for the next run, in 
the preconditioning phase of the method, the capillary is 
flushed with buffer. These flushes consume liquid, so from 
time to time the buffer vial has to be filled up again. For this 
purpose, the system offers the refill function. Instead of 
empt.ving and filling, the vial is only refilled to the desired 
level. 

It is possible to perform parallel replenishment by using two 
pairs of run buffer vials and replenishing the pair of vials for 
one separation run while anot her separation run is in prog- 
ress. This means that after the initial setup, no additional 
time is required for replenishment, provided that the separa- 
tion run time is not extremely short 
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HP CE Separation Control Electronics 
and Firmware 



The HP CE instrument consists of a PC and a base unit consisting of 
detection and separation subunits. Methods are developed on the PC 
and downloaded to the base unit for independent execution. The control 
electronics and firmware of the separation subunit takes care of tray and 
vial movement, capillary voltage, current, and power control, capillary 
temperature control, diagnostics, and related data capture. 

by Fritz Bek, Franz Bertsch, and Klaus Witt 



The HI' Capillar; electrophoresis instrument is built of two 
hardware units. One is a personal computer and I he other is 
the base unit, which contains all of the hardware needed lo 
perform the separation and detection. The electronics and 
die instrument software (firmware) of the base unit are the 
subjects of this article. 

The software running on the PC is die only interface to the 
user. There is no local keyboard on the base unit. A three- 
color LED is used as a status indicator on the front of the 
instrument. 

The PC (an HP Vectra computer) is connected via the HP-IB 
( IEEE 488, IEC 625) to the base unit and performs all data 
handling and user interface tasks. The base unit is built as 
two subunits — the separation subunit and the detection 
subunit — and therefore has two IIP-II5 addresses. 

There is no logical connection between the subunits. This 
allows the separation subunit to be compatible with future 
advances in delect ion technology and makes ii possible lo 
implement other detector types without changing the 
separation unit. 

The detection subunit (see article, page 20) is very similar to 
the multiple wavelength HPLC detecior of Hie HP 1050 LC 
system.' From the control point of view it is identical to the 
HPLC detector and electronically it is exactly tbe same. The 
cardcage, power supply, and printed circuit boards are un- 
changed. The local user interface is deleted. 

Like the detection subunit, the separation subunit has a 
cardcage in the rear that holds the various printed circuit 
boards and the power supplies. Most of the primed circuit 
boards are connected to a motherboard on the backplane of 
Ibis cardcage. except for the temperature driver board, the 
status indicator board, and the electromechanical interface 
board, which includes pressure sensors, connections to Hall 
sensors, and the power outlets for the various solenoid 
valves. The electromechanical interface board extends bum 
the front of the subunit to the motherboard. The mechanical 
hardware for liquid handling is comteeted by cables to this 
board or the motherboard. 



Controlling a Method 

A method is the sum of all of the parameter settings and 
commands that control a complete analysis. A choice of 
activities can be programmed to: 

• Refill liquid into working vials (replenishment) 

• Prepare the separation capillary (preconditioning) 

• Inject a certain amount of liquid from the sample vial 
(injection) 

• Perform the separation and collect data (run lime) 

• Evaluate data and generate reports (data analysis) 

• Clean up the system (postrun and postconditioning). 

During electrophoresis, electrolytic byproducts are formed 
at the electrodes in the Inlet and outlet vials, and the sample 
compounds move to either end of the capillary. Therefore, 
the running buffer will be spoiled after use. To prevent in- 
fluencing later analysis results, replenishment is used to 
prepare several vials with fresh buffer. Any existing liquid in 
the vials can be drawn into a waste bottle. The vials then 
can be filled to a specified level with new buffer from the 
reservoir bottle. During subsequent activities the refilled 
vials can be used as inlet or outiet vials, or as Hush and 
waste vials. 

Preconditioning consists of a set of commands lo specify a 
treatment of the inner surface of the separation capillary 
and to fill it with a reproducible composition of running 
buffer. A list of up to 10(1 entries can be specified with ac- 
tions like "nush with pressure," "apply high voltage," "wait" 
a specified lime, or "change" inlet or outlet vials to clean the 
electrodes of residual liquid. 

During the injection a liquid amount of typically five nano- 
liters is placed into one end of the capillary. This can be 
done by applying high voltage for a certain amount of lime 
or by forcing a pressure drop across the length of the capil- 
lary. While the voltage mode forms a plug How profile, the 
higher-mobility species are injected preferentially, which has 
to be considered when quantitative measurements are 
needed. The pressure mode does not change the quantitative 
composition, but the hydrodynamic flow profile reduces 
separation efficiency. For more complex injection tasks a 
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table of serial actions can be programmed, for example a 
sample plug followed by buffer liquid. 

During run time the electric field is applied to the capillary, 
which causes the different species to separate. The result is 
measured by monitoring the optical absorbance of the elut- 
ing liquid at up to five different wavelengths. For more com- 
plex tasks a full set of optical spectra can be acquired. For 
defect tracking and further evaluation, up to five other signals 
can be stored during the analysis. A timetable can be pro- 
grammed to change parameter settings during the run in syn- 
chronism with the sample plug injection. Electric field, dif- 
ferential pressure across the capillary, and temperature in 
the air around it can be changed as easily as changing vials 
on both ends of the capillary. 

After the measurement the separation path (capillary) can 
be cleaned by using a list of the same actions that were used 
for preconditioning. The capillary can be cleaned and filled 
with new liquid before the instrument is parked. 

The final result of a measurement is a report that states the 
composition of the sample, both qualitatively and quantita- 
tively. Using the spectral information, peak recognition and 
peak purity checks are possible. Calibration with previous 
analyses allows calculation of exact amounts. An experi- 
enced user can use the printout of an electropherogram to 
interpret, the results. 

Control Requirements 

The electrophoretic separation works like an impulse re- 
sponse. The injected sample plug is the impulse introduced 
into the system. Because each component of the sample has 
a different specific mobility, the response is a series of 
(hopefully) separated impulses with different peak shapes: 
the electropherogram. This impulse response is dependent on 
both the input impulse (the injection plug! and the system 
response. 

While the injection plug is mainly dependent on physical 
parameters, the system response is mainly dependent on 
chemical parameters, and both are dependent on timing 
relations. The injection plug depends on the geometry and 
length of the capillary, the viscosity and temperature of the 
liquid, and the value of the applietl force mult iplied by the 
time interval. While the first factors are not controlled but 
are more or less constant, the applied force and the time of 
application require good prec ision. If an injection of 50 mbar 
times 3 seconds is wanted with a precision of 1%, then a 
50-mbar pressure source is required with 0.25-mbar precision 
and the time has to be controlled within less than 16 MIS with 
transients taken into consideration. 

The system response acts in two different ways. One is the 
bulk speed of the liquid (electroosmotic How) and the other 
is the specific mobility of the separated compounds or mole- 
cules. These are primarily dependent on the length of the 
capillary and the voltage applied across it during the separa- 
tion (liming the run time), but are also dependent on the type 
of buffer and the temperature. There are also secondary de- 
pendencies, more chemical with the electroosmotic flow and 
more electrical with the conductivity and field distribution. 

To address the electroosmotic' How dependencies the sys- 
tem allows activities bundled as "preconditioning." This is a 



series of up to 100 steps specified by the user to pretreat the 
capillary's inner wall. This treatment can include: 

• Filling the separation capillary with mobile phase 

• Removing gas bubbles 

• Cleaning the stationary pliase using extreme pH 

• Exchanging the mobile phase 

• Conditioning the stationary phase to the final analysis pH 

• Reaching thermal equilibrium 

• Removing old sample from the capillary. 

Wliile the freedom to select a number of different actions in 
serial combination allows the user to address various prob- 
lems, the execution is reproducible and synchronized within 
100 ms. This is valuable because the time constant to reach 
equilibrium may be days. To speed up the analysis, it is use- 
ful not to wait until equilibrium is reached, but to gain repro- 
ducibility by precision in timing. Thus, the results ride on a 
wave. In HPLC there is no specific- timing requirement for 
other actions outside the run time. Different durations of 
injection cycles don't show a dramatic influence on the sep- 
aration results. But in HPCE preconditioning is a major as- 
pect. Reproducible results can only be achieved when the 
timing of the conditioning phase for repeated runs using the 
same method is always the same. It may be useful to have a 
constant time for feeding vials to the cassette, independent 
of the number of vials or the move distance. 

Because communication from the PC-based software to the 
instrument via the HP-IB is too slow, the instrument must 
have all of the parameters needed before the analysis is 
begun. Therefore, the complete method is copied to the 
instrument, which then executes it completely without 
interaction with the computer. 

Method Execution by Firmware 

The analysis consists of user-definable steps like replenish- 
ment of vials, preconditioning of the capillary, injection, 
running, and post conditioning of the capillary To achieve a 
high reproducibility of the analysis it is essential that the 
durations of the steps and the intervals between them have 
only small variations ( < 1 00 ms ). This is accomplished by 
generating the method on the PC and then downloading the 
method to the instrument, where the real-time operating 
system in the instrument takes care of the exact timing of 
the analysis. After the analysis the PC is responsible for data 
evaluation. The operating system in the instrument is a real- 
time, multitasking operating system previously used for the 
HP 1050 HPLC system. 2 

To address the conductivity and field distribution dependen- 
cies mentioned above the system allows selection of the 
control mode (voltage, current, or power) and the storage of 
the measured values of voltage, current, and power as raw 
data with the detector results. While voltage control is most 
predse When the conduc tivity is equally distributed across 
the capillary length, current Control keeps the field strength 
in the buffer portion independent of the conductivity of the 
injection portion. If temperature is the major influence, 
power control can keep the internal temperature rise in the 
capillary constant to adapt to changes in overall conductiv- 
ity, The stored measured voltage, current, and power data 
can be used for checking and diagnosis or to calculate spe- 
cific behavior. For example-, the mobility report uses the 
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voltage trace acquired during the analysis to calculate the 
apparent mobility of the species. 

Temperature 

The temperature or the capillary in the cassette has to be 
stabilized because it influences the electrophoretic results. 
One can Compare this with the therniostabilizalion of an 
HPLC column. Elect romobilities depend on solvent viscos- 
ity, which changes at a rale of about 2VC for typical buffer 
solvents. Chemical retention, if it occurs, is also influenced 
by temperature. In general, cooling is required because the 
current through the capillary heats the solvent and would 
boil the liquid with the sample in it. The temperature must 
be stable within at least ±0.1°C and perhaps as low as L0°G 
below ambient. 

For cassette cooling a Peltier element is used instead of a 
chiller. This element is made of semiconductor material, and 
with electrical current applied, one end is healed while I he 
other end is cooled. The direction of current flow defines 
which end is cooled. Thus the unit can be used for both 
heating and cooling by rev ersing the excitation voltage. 

During automated sequences the samples to be analyzed are 
kept in the liquid handling tray. If temperature-sensitive 
samples like biosamples are being analyzed, the sample stor- 
age area has to be cooled to as low as 5T to ensure that the 
samples are not spoiled while they are stored in the instal- 
ment. Wliile capillary cooling is always required, the tray 
cooling is an optional feature. The user can connect a chiller 
to control the I ray temperature and the III' ( 'E instrument 
will measure and display the tray's temperature. 

Forced-air cooling is used. The forced-air circulation has to 
be fast enough to ensure thai water condenses onl.\ on the 



surface of the cooling heal exchanger. This is important be- 
cause a wetted surface is able to conduct electrical current. 
With 30 kV in a sample bottle this can lead to unexpected 
high voltages in other areas of the instrument. 

An analog-to-digital convener (ADC) resolution of 12 bits is 
sufficient for all of the signals that need to be convened. The 
highest resolution is required for temperature control of the 
capillary and for raw data generation. A 12-bit ADC allows a 
resolution of 0,07.') |iA in current and 0.025 C in temperature 
measurements. 

One ADC is multiplexed to measure the analog signals for 
voltage, current, return current, pressures, and temperature. 
Multiplexing requires more firmware support. It is a load to 
the Interrupt tend Of the system processor and is therefore 
time-sensitive, but it saves hardware cost. 

Separation Subunit 

Fig. 1 shows the functional blocks of the separation subunit. 
which are: 

• Operating system 

• Vial and liquid handling 

• High-voltage control and safety functions 

• Thermal control 

• Replenishment and injection. 

These functions are separated onto different primed circuit 
boards. The separation subunit contains the following 
boards (sec Kig. 2): 

• Main processor board (CMP) 

• PC interface board (CUB) 

• Electromechanical interface board (EMI) 
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Fig. I. Functional block diagram ofthe separation subunit, 
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Fig. 2. Electronic block diagri rthe separation subunit ( 'RB = 

!'(' interface board. CMP - main processor board. KM I = electrome- 
chanical interlace board. PDV = serve boards. HVT = high-voltage 
and temperature control board. TI1R = temperature driver board. 

Four servo boards (PDV) 

High voltage and temperature control board (HVT) 
Temperature driver board (TDK) for Peltier Current control. 

Position Control Servos 

The central functionality of the separation subunit is vial 
handling. Up to 50 vials can be selected to be placed at either 
the inlet or the outlet end of the separation capillary. In addi- 
tion to taking a vial from the tray and placing it at a capillary 
end. the vial handling system has to place the vials at a de- 
fined height. Depending on the liquid level in the vial and the 
necessary depth of immersion for the electrode, a position- 
ing offset can be set. A position servo system is used to 
chive the lift spindle, which is able to provide position and 
force feedback. 

The same type of position servo is used for the tray move- 
ment. The servos are initialized to a special position and all 
vial positions are in reference to that. For the tray this spe- 
cial position is a fixed distance from the mechanical stop 
that prevents the tray from being turned more than one 
revolution. 

Every movement using the servo positioning is controlled by 
a smooth harmonic function. Both the speed and the accel- 
eration are ramped. This generates a stress-free moving pro- 
file that is easily calculated by the microprocessor at an 
80-Hz interrupt rate. 

lYay and Lift Initialization 

After power-up of the instrument the lifts and the tray must 
be initialized to a known state before the firmware can use 
them. The initialization procedure first interprets the current 
state of the mechanics, then finds the home positions for the 
servos, and then calibrates the lift positions relative to the 
segments of the tray. The sequence allows precise position- 
ing without adjustments of the mechanical assembly. The 
need for absolute position sensors is avoided by using the 
position and torque information from the servo drivers. This 
lowers (he cost, since even inexpensive sensors such as 
light switches and Hall sensors cost money and require ca- 
bling, connectors, and often adjustments. Furthermore, the 



presence of sensors in the high-voltage area could lead to 
reliability problems. 

The mechanism is designed to allow random access by the 
lifts to the vials in the Iray. To achieve this the lift finger is 
lifted through slits in the tray segments and the movement 
of the tray is blocked when the lift finger is within a slit. 
This means that the system needs to know the exact posi- 
tion of the tray segments relative to all lifts. All servos need 
absolute reference points for proper positioning. To bring 
the vials in the lift stations back to their correct locations 
after a power failure, the location of the vials is held in con- 
tinuous memory. 

To find the current state of the system the initialization pro- 
cedure first tries to initialize the tray. In most cases this is 
successful because the lifts have normally reached their 
upper or lower positions before the instrument is switched 
off. If the tray is blocked by one or more lifts the next step is 
to resolve the blockage. The lifts are moved down with re- 
duced torque. Because the orientation of the tray relative to 
the lifts is unknown in tins phase, it can happen that the lift 
finger is blocked by a vial or by a tray segment. In this case 
the lift is moved upward again out of the tray. Discrimina- 
tion between hitting a vial or a segment and a correct initial- 
ization of a lift is based on the characteristics of the torque 
increase when the lift finger hits something hard. The real 
endstop is much stiffer, so the torque increase as a function 
of distance is steeper compared to the situation when the 
lift hits a vial, for example. After this step no lifl should be 
blocking the tray. 

Xow the initialization and find home process starts. First the 
tray starts to initialize again, checking that its complete path 
is free. It does a full turn while monitoring the force to de- 
tect blockages. The lifts are now initialized and the vials in 
the lifts are brought into the corresponding tray locations. If 
there is any vial conflict, for example the user put a vial in 
location 20 of the tray while a vial with the same number is 
already in a lift station, the system sends an error message 
to the user to remove tins vial first, and the instrument turns 
the tray so that the corresponding location moves to the 
front access region. Because of problems like vial conflicts, 
the initialization process needs some user interaction. It is 
not recommended to start operation automatically at 
turn-on of the instrument. 

The next step is to calibrate the position of the lifts relative 
to the tray. Mechanical tolerances in mounting the lifts and 
segments are compensated by this calibration procedure. 
The lift finger of a lift is brought into the slit of segment 0 
and the tray is moved with constant torque to the left and to 
the right. The average of the positions reached gives the 
exact tray position for that lift. With the same procedure the 
position of every tray segment relative to the lifts is measured 
and stored in the continuous RAM. Every access to a vial 
uses the stored values to eliminate mechanical tolerances. 

Servo Control 

An application-specific servo chip, optimized for velocity 
control, is used in this instrument Special firmware routines 
generate the velocity profile to achieve a gentle movement 
of the servos. The servo chip uses current control to drive 
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the motor, awl the control error ran he used as a signal pro- 
portional to the required servo torque. This allows lull con- 
trol over the forces in the system. It also makes it possible 
to detect that a servo is blocked ami switch to the error re- 
covery routine to resolve the blockage. To achieve a good 
dynamic response of the servo, the motor driver can gener- 
ate a maximum current that will destroy the motor with just 
eight seconds of continuous operation. Therefore, to avoid 
damage we implemented a firmware fuse. The firmware 
calculates a simulated temperature of the motor according 
to the heat generated by the current through the winding, 
subtracting expected thermal losses, if this simulated tem- 
perature becomes too high the servo is switched off and an 
error message is generated. 

Movement Control 

The movement control firmware translates high-level move 
instructions into low-level move commands for the servos 
and a signal to indicate when an instruction has been exe- 
cuted. The high-level instructions include: 

• Find the home position for a servo 

• Remove the vial from a specified lift 

• Find a vial, put it in the lift, and raise it to a specified position 

• Set torque (move a servo with a specified torque) 

• Put the two home vials in then - lifts and raise them to their 
normal positions. 

The low-level move commands include: 

• restartservo. Find the orientation of the rotor and stator for a 
servo. 

• initservo. Find the zero position and search index. 

• segmentcheck. Measure the position of a tray segment relative 
to a lift. 

• move. Move a servo to a given position with a velocity profile. 

• findvialpos. Find the location of a specified vial. 

• findvialinlift Find which vial, if any, is in a specified lift. 

• storevialpos. Store the location of a vial in continuous RAM. 

• Signal the end of the high-level command. 

For example, say that vial 00 is in the replenish lift and vial 
25 is in the inlet lift and the task is composed of the high- 
level commands. "Find vial 30, put it in the inlet lift, and 
raise it to the default position." This is translated into the 
following low-level command sequence: 

• findvialpos of vial 30. This will find vial 30 in the replenish lift. 

• move vial position 30 of the tray under the replenish lift. 

• move the replenish lift downwards until the vial is in the tray. 

• storevialpos of vial 30 in the tray. 

• findvialinlift in the inlet lift. This will find vial 25 in the inlet 
lift. 

• move vial position 25 of the tray under the inlet lift. 

• move the inlet lift downwards until the vial is in the tray. 

• storevialpos of vial 25 in the tray. 

• move vial position 30 of the tray under the inlet lift. 

• storevialpos of vial 30 in the inlet lift. 

• move the inlet lift upwards until the default position is 
reached. 

• Signal the end of the command. 

These low-level move commands are put in a queue. The 
servo control firmware executes one element after the other 
from this queue. When a new high-level command arrives 
before the queue is empty the routine that translates the 



high-level commands to low-level commands can't use the 
actual vial locations because the conunands that are still in 
the queue may alter these locations. To follow the move- 
ment of the vials, every entry in the queue creates a virtual 
vial location which represents the vial location after this 
entry is executed. When a movement error occurs the queue 
is cleared. Depending on the type of error, the error recov- 
ery routine generates a new queue to bring the mechanism 
into a controlled state and gives a description of what 
caused the error. 

High-Voltage Control and Analog Signals 

The high-voltage power source is an encapsulated unit that 
contains two cascades, one for each polarity. A high-voltage 
vacuum relay is used to switch polarity according to the 
method settings. To interface the high-voltage power source 
to the microprocessor, some hardware is used to generate 
analog control signals and some monitoring signals are fed 
to the ADC. As mentioned above, the ADC is multiplexed to 
measure the analog feedback from the high-voltage power 
source, the pressure and vacuum signals, and the tempera- 
tures. Digital status information from the high-voltage 
source is fed to the microprocessor for control and error 
detection. 

A double-contact relay is implemented for safety purposes. 
In any emergency condition this relay breaks the 21V supply 
for the high-voltage power source. The double contact (two 
contacts in series) ensures the required safety level for this 
type of Functionality. 

Voltage, Current, or Power Control 

Historically, voltage control has been used for electrophoresis. 
This keeps the field strength constant during t he analysis. 
However, even the best cooling and therntostating of the 
capillary's outer wall cannot prevent a temperature rise in- 
side in the liquid, especially when using a high salt concen- 
tration. A temperature rise changes the viscosity and thus 
the mobility of the various species. This makes the different 
peaks elute faster, even when the field strength is kept con- 
stant. Because the conductivity of the buffer liquid also in- 
creases with rising temperature and thus the .joule heating is 
increased, this effect is self-amplifying. 

In such a situation, current control is advantageous. With 
current control, the feedback loop causes the voltage across 
the capillary to decrease when the conductivity increases as 
a result of an int ernal temperature rise. Thus, the effect is 
more self-limiting. However, measuring very small currents at 
high voltage is difficult, so the precision of current control is 
not as good as voltage control: 1% compared to 0.1%. 

In thermally sensitive applications it may be advantageous 
to use power control. Variations in conductivity are then 
compensated, leading to a more reproducible internal 
temperature, which in turn stabilizes the analysis results. 

Voltage Measurement 

The high-voltage supply outputs a signal proportional to the 
high voltage at the output This signal is used for monitoring, 
pow r er control, electromigration injection, raw data to the 
PC for data evaluation, and limit sensing. 
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The output voltage is controlled by the high-voltage source 
internally- This means that voltage measurement is not re- 
quired for voltage c ontrol. The major performance require- 
ment is the precision and stability of the output voltage; ab- 
solute accuracy ' s secondary- The HP CE design yields a 
precision of 0.1%, which means only 10V fluctuations on a 
HMcY output. 

Current Measurements 

Two current measurements are made on the high-voltage 
source. One is the current monitor signal from the high- 
voltage power supply and the other is the current at the 
capillary outlet next to the detector. For the latter, there is 
a current sense resistor between the vial ground electrode 
and the power supply's grounding pin. This leads to the re- 
quirement that the ground electrode be insulated. Even 
when there is no voltage difference, the current must be 
confined until it is measured. This measurement detects 
current from the high-voltage supply that is not flowing 
through the capillary. Such leakage current can be caused 
by wet surfaces or carbon tracks in plastic parts. It is a good 
safety and diagnostic - feature to detect such leakage traces 
in the high-voltage path. 

The measured current data is used for monitoring, limit sens- 
ing, power control, elect romigration injection, raw data to the 
PC for data evaluation, leakage current detection, and bubble 
detection. For generation of raw current data only the return 
current from the capillary is used. This signal is integrated to 
determine injection volumes during electromigralion injection 
when the current and time have been specified. 

Corona effects, sparking, and insulation breakdown are de- 
tected and a yellow warning flag is displayed on the PC user 
interface CO point out these problems. 

To stop the analysis when a gas bubble has formed inside 
the capillary, a lower current limit can be set. If the current 
is not over this limit half a minute after voltage is applied, 
the analysis will be terminated to prevent local burning of 
the capillary. 

Pressure Measurements 

Data from pressure measurements is used for control of the 
pressure source, hydrodynamic injection, liquid level sensing 
during refill, raw data to the PC. and diagnosis and error 
detection. 

For various needs, the pressure source can Supply Up to 1 bar 
of pressure and 0.4 bar of vacuum. Both pressures are stored 
in reservoirs which are filled Sequentially from a membrane 
pump. This bipolar source allows push-pull actions which arc 
used for empty-refill operations, up-down injection profiles, or 
controlled bipolar pressure across the capillary. 

Injection Control Algorithm 

To get high reproducibility for quantitative measurements in 
CE it is essential to have a very precise injection process. The 
HP CE instrument allows either hydrodynamic or electro- 
migration injection. In the hydrodynamic injection mode the 
injection volume is determined by the time integral of pres- 
sure across the capillary. This pressure/lime integral can be 
as low as 20 mbar s. When pressure is applied by simply 
opening a valve for a specified lime the slope of the pressure 
during switching of the valve is not very reproducible. Gas 



rushing through the system will cause pressure drops that 
may result in transient errors in the pressure sensor signal 
relative to the real pressure generated across the capillary. 
Therefore, as described earlier, the HP CE instrument uses 
pressure tanks as gas flow sources with high output imped- 
ance. The conditions are controlled so that the pressure 
increases or decreases according to a linear ramp function. 
With the bipolar gas sources this ramping can be performed 
in both directions, With this system, valve switching time, 
the resistance and capacitance of the tube and chambers, 
the signal sampling rate, and even limited leakage are no 
longer factors that influence the precision of the pressure 
integral applied across the capillary. 

To finish the injection profile another valve is switched to 
ramp down the pressure in the inlet vial. A kind of pulse 
width modulation is used to achieve a predefined slope. At 
specific pressure values during the ramp the system checks 
to see if the integral has reached the appropriate value By 
design, the integral will always be smaller than the expected 
value. The ram]) is then stopped and the pressure is held 
passively until the measured integral is correct, and then the 
ramp Starts again. Tltis leads to a successive approximation 
of the integral until the target value is reached within ±0.3%. 

For hydrodynamic injection a variable pressure can be se- 
lected in a range of ±50 mbar. For flush and clean procedures 
the full pressure of about 1 bar is applied to the inlet vial. 

Replenishment Control 

During the analysis the content of the run buffer will be- 
come modified by the addition of electrochemical by-prod- 
ucts. To achieve good reproducibility of the analysis the run 
buffer should be exchanged after several inns. The replen- 
ishment system allows the user to empty a vial, refill a vial, 
or bring a vial to a desired level aulomaticaliy. 

To determine the liquid level in a vial the following steps are 
execuled: 

• Draw a small airflow through the short end of the replenish 
double needle and measure the pressure drop in the needle. 

• Move the vial slowly upward against the end of I he capillary 
and wail for a sharp increase in the pressure drop, indicat- 
ing that the needle has touched the liquid surface. 

The noise of the pressure sensor must be very small because 
the detection algorithm uses the slope of the pressure to 
achieve a small delay between touching the surface and 
detection. For a complete description of the replenishment 
system, see the article on page 32. 

Capillary Temperature Control 

Because a temperature change of 1 C changes the viscosity 
by more than 2% and viscosity has an influence on ciectro- 
phoreiic mobility, the capillary temperature must be con- 
trolled so thai il is stable within ±0.1°C so as not to degrade 
the analytical reproducibility. 

The capillary temperature is controlled by heating or cool- 
ing, depending on its relation to ambient. A Peltier cooler is 
used as a cooling element for the capillary. By reversing the 
current polarity the same element rail be used for healing. 
Because its power efficiency may be as low as 20%, an elec- 
trical supply of 100 walls is required. A current source was 
Selected to drive Ihc Peltier element because in Ibis type of 
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application I he Peltier is much more linear than with voltage 
control. An additional benefit is thai Current conlrol is inde- 
pendent of the supply voltage, which allows operation with 
an imstahili/.ed voltage, reducing the cost of (he power supply 
and increasing the overall efficiency. 

The efficiency of a Peltier cooler is dependent on the tem- 
perature difference between the hot side and the cold side. 
Al a certain temperature difference there is no more cooling 
even when more electrical power is supplied. To avoid oper- 
ation in ibis region both Peltier side temperatures are mea- 
sured. This information is also used to prevenl either side of 
the Peltier from becoming heated above 80°C. which would 
decrease the lifetime dramatically. 

The temperature to be controlled is not the Peltier's, but (he 
capillary's. While the exact temperature of ( he capillary is 
hard to measure because of the size and geometry, the air 
temperaiure around the capillary tracks it closely in value 
and time. Therefore, a sensor is placed where the airflow 
exits the capillary cartridge. This allows a fixed location for 
the sensor and wiring while the cartridge is easy to access. 
The high airflow speed of 10 m/s provides good, fast thermal 
contact between the capillary and the Ihennoscnsor. 

Cascaded Control 

To achieve good precision combined with steep slopes, a 
cascaded control concept is implemented. This requires a 
little more hardware and firmware, but offers better control- 
lability along with flexibility and ease of optimization. This 
saved risk and speeded the development process. 

As already mentioned, the efficiency of the Peliier is sirongly 
dependent on the temperature difference between its hot and 
cold sides. Therefore, il is wise to keep the temperature dif- 
ference between the air and the Peltier as low as possible. 
This leads to a heat sink large in size and volume. A good 
heat sink material is metal, which has a high thermal capaci- 
tance. The result is a long dead time and a high lime constant 
between the Peltier temperature and the air lemperature. 

Conventional control algorithms are either slow or show 
long ringing or instabilities. The cascaded control loop of 
the IIP CE instrument uses a sensor close to the Peltier's 
cold side to achieve speedy measurement for steep slopes 
and good stability. However, the ambient rejection is not so 
good. Varying loads, dominated by the ambient temperature. 



may lead to a temperaiure difference of up lo S'-'C between 
the heal sink close lo the Peltier and die air at the capillary. 

To correct this problem, a second control loop is imple- 
mented around the conlrol loop that stabilizes the tempera- 
lure al the Peltier. This outer loop overrides the setpoint 
value for (he first, loop and adapts to ambient changes in the 
"minute" range while the inner loop of the cascade operates 
in the "second" range. As soon as the inner loop reaches a 
temperature close to its setpoinl, the outer loop is activated 
to adapt the setpoint accordingly to reduce the difference 
between the capillary air temperaiure and I he user- 
programmed value. 

The Peltier element is mounted on a heat sink built into the 
top rear area of the Instrument above the two card cages of 
the subuhit& The swilched-mode current source is on an 
extra printed circuit board next lo the Peltier. The power 
transistors are connected to the same heai sink as the 
Peltier's hot side and therefore can be cooled efficiently. 
The current source is controlled by two digital signals. One 
signal controls the power direction and the other defines the 
current through the Peltier. 

The pulse width modulation for the currenl source has a 
frequency of about 80 kHz with 180-step pulse Width resolu- 
tion using a clock of (j.GG MHz. An 8-bit data word is needed 
for Ibis, but if only 8 bits were used, the limited resolution 
would require a fast response to keep the resulting fluctua- 
tions small. Therefore, a 6-bit fine-tune feature firsl used in 
the HP 1050 HPLC system is used for Peltier control to keep 
the temperaiure stable within ±u.l T or better. This gives a 
controllable dynamic range of about 10000:1 with the highest 
resolution at low power values. The conlrol loop calculates 
a 14-bit control signal every three seconds. This calculation 
is somewhat complicated, but is not executed very often. 
The upper 8 bits are fed to the pulse width modulator, while 
the lower (i bits are used to modulate (he pulse width modu- 
lator in a 12.5-ms tune slice (see Fig. 3). The benefit is a 
higher base frequency, which is filtered better by the thermal 
time constant of the system. Thus, the required temperature 
Stability is achieved with inexpensive digital hardware, simple 
firmware algorithms executing at an 80-1 Iz rate, and complex 
calculations every three seconds. 
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Safety 

To guarantee user safely, the HP CE instrument implements 
a number of safety features. Tray rotation is stopped after a 
maximum of 400 ms when the tray door is opened. Any 
movement that was in progress is finished after the door is 
closed again. The high-voltage power supply is brought to 
0V and switched off when the top cover is opened or when a 
leak is detected. The cassette fan is switched off when the 
top cover is opened to avoid finger usuries. Pressure on ttlt 
vials is released immediately when the lop cover is opened: 
otherwise, the vial contents would be sprayed inside the 
detector compartment. Pressure is removed from the buffer 
bottle if a leak is detected. 

Evaluation 

When a concentration dependent detector signal is inte- 
grated over time the peak area is a measure of the amount 
of separated sample compound. The sample area and the 
amount are related by the speed of the absorbing particles 
as they move through tiie detector cell. 

In I1PLC separations the speed of the sample is normally 
known. It is the flow rate of the liquid. In electrophoresis, 
the separating power is the difference in the mobility of the 
compounds, which means that the compounds have differ- 
ent specific speeds while moving through the detector. 

To correct for speed differences in later evaluation steps, 
information about the moving force is needed. In a simple 
analysis the voltage is constant during the complete run. but 
temperature changes have an influence on viscosity and 
mobility, and a time-programmed voltage or fraction collec- 
tion can have a tremendous influence on ahsolule-area-lo- 
amount calculations. 

To support future ev aluation developments the HP CE in- 
sirument supports five raw data channels in addition to the 
detector signals: 

Voltage, current, and power of the high-voltage source 
Pressure across the separation capillary 
Temperature of the air from the cassette. 

Diagnostics 

Traditionally, diagnostic routines built into instruments are 
based on the perception that the failure modes are already 
known during the development phase. For these failure 
mechanisms special leslsare implemented (RAM. ROM. 
communication, display, etc. ) which generate a pass/fail 
indication or a value. Sometimes the knowledge of a specific 
failure mode in the early development phase leads to 
changes of the product lhal reduce or even eliminate the 
failure mode. However, there is no possibility of avoiding 
the learning curve. Unexpected behavior and dependencies 
always appear alter the product is released, and may in- 
crease the list of diagnostic functions needed. Thus. Ihe 
diagnostics implemented in the early phase might be of little 
use while those most needed are not supported. The disad- 
vantage of Ihe traditional concept is lhal the diagnosis of 
failure modes discovered after the development phase is not 

possible without product changes, 

The IIP CE instrument implements traditional diagnostic 

(unctions as outlined above, hm the firmware also imple- 
ments basic functions for diagnosis, such as read sensors, or 



write to hardware address. Macros on the PC" can use these 
basic functions to construct complex diagnosis functions to 
address specific problems. Now if a new failure mode is 
discovered, we just add a diagnosis macro for it and create 
an updated version of the diagnostics disc to distribute it to 
the manufacturing and service organizations. This leads to a 
continuous improvement of the diagnostics for the instru- 
ment, and we spend the time to create diagnosis functions 
only for failures lhal have acluallv occurred in the field. A 
valuable side effect is that most module test routines are 
implemented within the product, so manufacturing does not 
need a large amount of special equipment. The service per- 
son at the customers site has all the equipment needed to 
perform the same tests as originally used in Ihe factory. 

Diagnosis Functions 

The instrument normally collects equally spaced data for 
voltage, current, power, vial pressure, and temperature in a 
buffer memory in the instrument RAM. The diagnosis firm- 
ware makes ii possible to redirect other data like servo 
speed, servo posilion, servo current, sensor data, valve states, 
and so on to this buffer. Thus, we can store up to five config- 
urable measured v alues, with a configurable data rale of up 
to 20 Hz. The PC software reads this buffer and generates 
reports and graphics. 

This tool greatly improved Durability to find bugs during the 
development phase because we got the history of servo 
positions, pressure values, and other measured values when 
an error occurred. It also gave us much more insight ( like a 
built-in oscilloscope for electromechanics) into what really 
happened in the unit than we would have obtained from 
single measurements. 

An advantage of this firmware feature is thai service person- 
nel can use il to find problems in the field and can semi the 
printout to the factory for a simple form of remote diagnosis. 
An example is the macro for checking Ihe pressure syslem. 
Il lakes about fiv e minutes and checks the power of the air 
pump and the lightness of the pressure and vacuum system, 
the injection system, and the replenish system and stores 
the dala from all of Ihe pressure sensors. A graph of these 
quantities characterizes most of the pressure syslem and 
helps diagnose the problem if there are deviations from Ihe 
normal behavior. 
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A User Interface for Capillary 
Electrophoresis 



The graphical user interface of the HP CE instrument is designed to be 
easily understood by users familiar with other separation methods but 
new to CE. It provides for method programming and simulation and for 
visualization of the status of the instrument and the running analysis. 

by Alwin Rilzmann and Klaus Witt 



The architecture of the user interface for the IIP CE 
instrument is similar to HP's I.C ChemStation. Like the LC 
ChemSlation, it uses Microsoft ! Windows as a platform. 
Because electrophoresis is seen as similar to IIPLC and I lie 
same type of diode array detector is used, it made sense to 
US that the user interface should be similar. It also helps that 
both systems are developed at the HI' Waldhronn Analytical 
Division . 

The HI' CE ChemStation consists of an HP Vectra 486/66XM 
or compatible computer with 12M bytes of RAM, a -120- 
Mbyte hard disk drive, an HP-IB (IEEE 488, DEC 1)25) card. 
MS-DOS* 6.xx, and MS Windows 3. 1 or higher. The PC is in 
charge of data handling, which includes all functions with 

midrange timing requirements: 

• Sequencing 

• Collection of method parameters 

• Method storage 



• Long-term control of the instrument 

• Error handling 

• Collect ion of run-time data 

• Data processing (e.g.. integration) 

• Report generation 

• Message logbook and error log 

• User-controlled liquid movements. 

User Interfac e Strategy 

A major objective for die user 1 interface was to help the user 
no! be afraid of the meastuing device. Because CE is a new 
separation technique, many users will be switching from 
other procedures they are already familiar with, and their 
expectations may be basically different. A person acquainted 
with slab gel electrophoresis will have no problems with high 
voltage, but sequence analysis programming and automatic 
data analysis with calibration will be new. A chromatographic 
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expert, on the other hand, will consider these aspects old 
hat, but step-by-step conditioning and the frightfully high 
voltage may be new. 

A graphical user interface was selected to provide visibility 
into the operation of the instrument and thereby counteract 
any initial problems by conveying the feeling to the user that 
the measuring device is controllable. Communication with 
the user by interactive visibility is a great advantage. Many 
applications cannot be imagined without icons, 3D buttons, 
WYSIWIG, or multimedia anymore. It is far more comfort- 
able to follow the consequences of one's behavior on the 
screen interactively. 



The grapliical user interface of the HP CE system is designed 
particularly to address the following three objectives: 
Visualization of a programmable but automatical!) naming 
process, as feedback to the user 

Context dependent or function-related access to specific 
settings or value groups 

Manual control of specific functions for which direct trigger- 
ing is impossible or unreasonable in automatic operation. 

Visualization means not only the extensive but clear repre- 
sentation of as many values, activities, or processes as pos- 
sible, but also the ability to simulate a programmed method. 
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Development of a Common ChemStation Architecture 



The HP CE user interface is based on a common HP ChemStation architecture. 
The architecture and many software components are shared with ChemStations 
previously developed for other analytical techniques. For example, because most 
ol the HP CF ChemStation functionality is identical with the high-performance 
liquid chromatography (HPLC) ChemStation (automation, data acquisition, process- 
ing of measured data from the detector, and reporting), about 80% of the HPLC 
ChemStation code was reused This article describes the evolution of this com- 
mon software architecture and the core software components 

The tenii ClieiiiStaluiii was created tu descnbe the use uf a wurkslaliun as a tool 
for an analytical chemist. Independent of the analytical technique, the user works 
with a ChemStation to control the analysis system, acquire measured data, pro- 
cess the data, and create the analysis report. In addition, these complex functions 
must be fully automated for unattended operation. As PCs became very papular 
for the chemist's desk as well as in the analytical laboratory, HP product genera- 
tion organizations, together with a system development group, defined the follow- 
ing objectives: 

• Develop a ChemStation architecture based on the Microsoft® Windows platform. 

• Develop reusable components from which various products can be assembled. 

• Develop selected architecture-neutral components to be used for other data sys- 
tem platforms (e.g., UNIX " system-based workstations! 

The architecture for the ChemStations is based on the available Windows technol- 
ogy. The development environment is based on the Microsoft development tools 
(C, C++, MS foundation classes, etc.). Both the Windows platform and the envi- 
ronment have evolved significantly during the last couple of years. 

Because the common software components were developed by an international 
team, an appropriate infrastructure was set up to support the engineers working 
at two sites, one in the U.S.A at Wilmington, Delaware and one in Waldbronn. 
Germany A history management system IHMSI, telephone conference equipment, 
small decision making groups, and system build processes were defined and 
implemented. The product development program was set up so that the software 
development groups were not isolated from the instrument development groups. 

The infrastructure as it exists today is much different from the way it was defined 
in the beginning As we learned how to deal with such a complicated environ- 
ment, we went through several steps with the infrastructure and the organiza- 
tional structure to make sure that the variuus software product generation groups 
were linked together 

The architecture and the development of the ChemStation products also went 
through several evolutionary steps. We always focused on clear product examples 
during the development Df the core components. This approach made sure that the 



Simulation is an advantage when, for example, a process 
that will nin for a Ions time needs to be checked quickly for 
completeness aftd consistency, or when a method is being 
edited whose execution would not be possible given the 
present state of the measuring device. 

User Interface 

The HP CE ChemStation has one .EXE file and one top-level 
window, including the command processor. The top-level 
window contains child windows that are activated on user 
request. A status window and die online diode array detector 
plot window are shown by default. The top-level menu is 
user-definable and supports additional short menus. 



software development met the instrument requirements for the various analyical 
techniques. We also had to maintain the architecture and the core components 
according to the fast-changing Windows platform technology 

The first step was to introduce software products for HPLC, HPCE, and UV/Vis 
instruments. All these software products were built on the available common 
software components As an example, the analytical language processor, a BA 
SIC-like language, is used in all the products as a common key component. In a 
second step we went further and built one core software product supporting 
HPCE, GC. HPLC. and analog-to-digital converters "Plug and play" modules spe- 
cific to various instruments and analytical techniques can be added to the core 
software product This is the basis for the recently introduced multitechnique 
ChemStation, which provides control, automation, and data handling for up to four 
GC, LC, or CE instruments and an optional analog-to-digital interface. This product 
is always delivered with the core software and an individual module for one spe- 
cific analytical technique. If the customer wants to add another instrument, either 
for the same analytical technique or to combine techniques (for example, HPLC 
with CE), another module can be ordered and installed to work with the core. 

This approach is very efficient and highly appreciated by our customers and field 
people. If the customer knows how to operate one product it is easy to operate 
the ChemStation for another analytical technique. The customer can concenlrate 
on the analytical technique and always finds the same user interface Other 
techniques, such as UV/Vis, SFC, and so on, share all the common components 
from the core and therefore are on the same architecture. 

This approach has resulted in a very high reuse level — between 65% and 
85% — and ensures that all the products meet high quality standards with a rea- 
sonable amount of testing and software validation effort 

Development of the common ChemStation architecture was only possible through 
the involvement and cooperation of many people throughout various HP organiza- 
tions, who deserve a great deal of credit for these achievements 

Herbert Wiederoder 
Section Manager 
Waldbronn Analytical Division 

Microsoft is a U S registered trademark of Microsoft Corporation 

Windows is a U.S trademark of Microsoft Corporation. 

UNIX is a registered trademark in the United Stales and other countries, licensed exclusively 
through X/Open* 1 Company Limited 

X/Open is a registered trademark, and the X device is a trademark, of X/Open Company Lim- 
ited in the UK and other countries 



As the name capillary electrophoresis indicates, we are deal- 
ing with an analytical measuring method taking place in a 
capillary with the help of an electrical voltage. The Capillary 
is selected by the user based on specific criteria and is reeled 
up in a cassette which is then inserted in the measuring de- 
vice. A picture representing die cassette forms the center of 
the top-level window of the graphical user interface (see 
Fig. 1). 

In the top-level window, the state of the HP CE instrument is 
shown. Any important information is obvious at a glance, hi 
accordance with the setup in the instrument and following 
the function as it Ls seen by the user, the respective functional 
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elements are arranged around I lie cassette. The user can 
immediately associate functional modes with the stylized 
pictures and thereby get a clear impression of the process 
and present Status even without having much experience. 

Each group of functions is represented by an icon or symbol 
showing the current state. A user who has a specific inten- 
tion can select the component on the graphical interface 
that comes closest to it. If the mouse pointer is clicked on a 
component, a pop-up menu field appears close by, listing the 
functions linked lo the component. In the case of the detec- 
tor, for example, the pop-up menu offers lamp on/off or 
wavelength selection. When the battery icon is clicked, a 
pop-up menu of electrical parameters shows up (see Fig. 2). 
A specific icon in the menu field (the book symbol) immedi- 
ately shows whether an action results in the modification of 
the method. 

Fig. 3 shows the layout of the top-level window. Wherever 
possible, a combination of analog and digital display was 
chosen. Analog display facilitates the quick qualitative grasp 
of i lata h\ the human mind. Precise representation H rml- 
i/.ed by the additional digital display. In the iuialog display of 
the electrical parameters, for example, bar charts make 
stales quickly visible to the user without too much thinking. 



For exiunple. one can recognize at once whether I he pro- 
grammed value has been reached and how far away the ac- 
tual value is from the system limit. These things could be 
conveyed with the digital display alone, but would be much 
harder to comprehend. 

Status Line 

In the left comer, the topmost line shows the current state 
of the instrument ( Fig. 4). Different colors are used to help 
the user visualize the instrument state. For example, green 
is used for all ready, blue for running, yellow for not ready, 
and red for error states. Text matching the respective state 
is displayed in the field. To the right, there is a run indicator 
in which an animation starts naming as soon as an analysis 
begins. The animation quickly provides optical feedback 
that an analysis is in process without requiring the checking 
of different states beforehand. 

A clock in Ihe status line displays the times for different 
actions. It is not a 24-hour clock, but displays the lime 
elapsed relative to the total time. A full turn of the clock 
symbolizes the total lime of a process. The precise elapsed 
time is displayed digitally below Ihe clock. The clock runs 
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Fig. 7. Ruribar. 



backward for actions taking a fixed period of time (e.g., 
flush for 3 minutes), thus showing the remaining time of the 
action. For procedures containing programmable actions 
(e.g., run), trie clock runs forward, showing the time elapsed. 

Measurement Unit 

The cassette with the detection unit is the core of the user 
interface and the instrument (see Fig. 5). In the center of the 
user interface, everything in direct connection with the cap- 
illary, and thus the separation, is displayed. One can see 
whether the lamp is switched on or off, whether voltage or 
pressure is applied to the capillary and which vials are in 
contact with the capillary. The temperature inside the capil- 
lary cassette can be read. The pressure bottle symbolizes 
the pressure system. The black connecting lines show the 
existing connections to the capillary or the vials. They 
change to red when power Ls applied, to blue when com- 
pressed air is supplied, and to pink for vacuum. The pres- 
sure applied is displayed in the pressure bottle. Thus, it is 
quickly visible what is switched on at a given point in time. 

Replenishment 

The replenishment system display shows which vials are 
present ly Tilled or emptied. For examples, see Fig. 6. Pressure 
on the lines is shown in blue, vacuum in pink. 

Run bar 

The runbar (Fig. 7)is designed to provide an overview of the 
entire analysis. With its help, the user can see how far the 
analysis has proceeded. An analog bar displays the relative 
durations of the individual parts of the analysis in different 
colors. 



Shows Actual Value 
(If Bold then Programm 
Limit Has Been Reached) 



The runbar gives the user the following information: 

• Which step is presently in process (colored parts) 

• What fraction of the total time is consumed by each 
individual step 

• Completion of the analysis (overall time) 

• Time since the start of the analysis (triangular arrow) 

• Position of the current step in the analysis 

• Individual steps executed 

• Whether parallel replenishment is active. 

This helps the user get. a clear overview of the state of the 
analysis. A short glance at the analog display suffices for a 
qualitative impression. 

Detector and Electric State 

The current values of the detector and the electrical unit are 
shown on the left side of the user interface. In the electrical 
parameter display (Fig. 8) voltage, current, and power are 
displayed and can be controlled. Whether voltage, current, 
or power control is enabled is indicated by a bold digital 
numerical value and a black bar (actual value) obscuring the 
corresponding green bar (reference value). The camera sym- 
bols show where data is being recorded. The display of the 
electrical values is located opposite the battery symbol. 

The detector settings are shown in the user interface oppo- 
site the detector symbol (Fig. 9). Here, the settings for all 
channels can be read. Channels for which data is being re- 
corded are indicated by camera symbols. 

Online Plot Area 

In the online plot area (Fig. 10) are two signal windows in 
which the signals from the detector or the electrical unit 
can be displayed. The displays show the values presently 
measured. 

Upon the click of a button, either plot window can be en- 
larged so that more precise values can be read and the curve 





Polarity 
Data Recording in Progress 
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L - Black Bar: Actual Values 
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Fig. 8. Electrical parameter display. 
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Fig. 10. i inline pkxs and en- 
larged plot. 



trace can be better followed ("lie-king on the enlarged signal 
enables tracking uf the signal nin e and precise determina- 
tion or individual values. 

Simulation of a Method 

Simulation is used for verification of a programmed method. 
The complete sequence of a method can be shown in the 
user interface. All actions are displayed as if the instrument 
were running. The simulation is software-based and does 
not require any hardware. 

When the simulation is initiated, a control dialog appears 
which facilitates navigation tluough the simulat ion. Moving 
forward arid backward in single steps Is possible. W ith each 
step, the corresponding time at which the action is executed is 
displayed. The simulation only shows steps causing a change 
of state. A nm button makes continuous stepping possible. 



By simulation, the user can verify the complete sequence of 
a method before the actual run to make certain that the 
method is error-free. Especially in the case of methods with 
long run times, it makes sense to check fan advance whether 
everything will go as planned or if program faults have 
slipped in. The user can also see in advance how long the 
analysis and the individual steps will take, and Whether 
there are any conflicts. 
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Reproducibility Testing of the HP CE 
Instrument 



The final chemical test developed for the HP CE instrument implicitly 
checks various instrument functions by determining the reproducibility of 
migration time and peak area measurements for well-defined chemical 
samples The injection type was selected by testing four different types in 
a series of reproducibility tests. The final test can be used in production, 
at a customer site, or for teaching CE basics. 

by Ulrike Jegle 



Instrument tests are indispensable for quality assurance of 
highly integrated systems. Only tests of the whole system 
guarantee a quick setup of lite instrument at the customer 
site and a minimum failure rate in daily use. All hough the 
components of the IIP CE instrument are tested separately 
for functionality, < he integrated system has to be lesled for 
successful coexecution of all built-in elements, Besides 
I'uncl ionalily lests, the procedure for the HP CE instrument 
ittdudes measurements of detector properties (noise detec- 
tion) and reliability determination within a reasonable test 
time 

For the final test of the IIP CE instrument, a lest procedure 
was implemented Ihal exercises the instrument under real- 
life conditions. A chemical test procedure had to be devel- 
oped for I his. Besides testing the instrument functions, ot her 
important aspects had to be considered for this chemical 
test. The final test had to be fast and easy to execute and 
use commercially av ailable and nontoxic chemicals. In addi- 
tion, it was desirable that the lesi be usable as a customer- 
site test. Teaching aspects were also considered in choosing 
the test separation procedure, so that the lest could be used 
to show the basics of the relatively new capillary electro- 
phoresis technique; The advantages of dual use of the final 
test are cost reduction and. more important, the possibility 
of obtaining comparable results in final tesl and customer 
lests for validation reasons. 



Table I 

Conditions for Chemical Final Test 

( 'apillary: Bare fused silica 

TJOtaJ length: 48.5 cm 
Effective length: -10 cm 
Inner diameter: 50 um 



Conditioning: 
(pretreatment before 
first use) 

Hun Buffer: 
Solute: 

Preconditioning: 
(before every run ) 

.Separation: 



Detection: 



I lata Analysis: 



Flush: 10 min 1M NaOH 
Flush: 2 min 0.1M NaOH 
Flush: 3 min ran buffer 
All sleps canned out at 60°C 

20 mM sodium phosphate pH 7 

1 mM each thiamine, nicotinamide, 
nicotinic acid dissolved in water 

Flush: 2 min 0.1M NaOH 
Flush: 3 min ran buffer 

Voltage: 25 kV 
Polarity: positive 
Temperature: 40°C 

Wavelength: 215 ran 
Bandwidth: 16 ran 
Reference: off 

Initial threshold: -2 



Test Description 

For the chemical final test, bare fused silica capillaries are 
used to separate a set of three vitamins — thiamine (positively 
charged), nicotinamide (no Charge), and nicotinic acid (neg- 
atively charged ) — using a 20-mM sodium phosphate buffer 
of pH 7 as run buffer. The vitamins come in a lyophilizcd 
mixture that has to be dissolved in water before use. 

To complete a high number of runs wit hin a reasonable lest 
time, short preconditioning and separation intervals are 
required. Short run limes can be achieved by high 
electro-osmotic flow and high analysis temperature. 



To guarantee a high eleclroosmolic flow, the capillary is 
pretreated before its first use with 1M sodium hydroxide at 
(SO'C. Treatment of the fused silica wall with 1M Sodium 
hydroxide solution at an elevated temperature results in a 
maximum of charged silanol groups on the surface, which is 
the basic prerequisite for high eleefroosmotic How. A sec- 
ond rinsing step consisting of a 2-miiuite flush with 0.1M 
Sodium hydroxide and a 3-niinute flush with phosphate 
buffer is added to be as consistent as possible with the pre- 
conditioning slep used before every run. The capillary 
conditioning with 1M NaOH is carried oui once before the 
first use of the Capillary for the final test and is not repeated 
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Table II 

Factors Influencing Migration Time Reproducibility 

Instrument Parameters 

Constant Cassette Temperature 
Peltier Element 
Fans 

Constant Separation Voltage 
Power Supply 
Connections 

Constant and Reproduc ible Liquid Level in Replenished 
Vials 

Pressure System 

Valves 

Tulie Connections 

Chemical and Physical Parameters 

Eleetroosniotic Flow (Zeta Potentialt) 
Fused Silica Material 

Bulk 

Surface 
Buffer 

pH 

Ionic Strength 
Type 

Viscosity (strongly temperature dependent ) 
Equilibrium State 
Preconditioning 
Buffer Type 



1 Zeia potential is lie potential difference Between the capillary wall surface and tne bulk 
solution 

during Ihc lest. The preconditioning is a Hush step canned 
onl before every single run. Here weaker conditions are 
used: 0.1M NaOH and run buffer. 

hi addition lo creating a high elect roosmolic flow, the run 
time of the vitamin separation is optimized by using a run 
temperature of 40°C even though Ibis impairs the separation 
efficiency. Increasing the temperature results in a decrease 
of buffer viscosity of 296 per degree. This causes higher flow 
velocity of the run buffer. The preconditioning and separa- 
tion conditions are listed in Table I. 

II has been shown (see "Final Test and Results" below) that 
the lest mixture of thiamine, nicotinamide, and nicotinic 
acid can be separated with high reproducibility of migration 
time and peak area under Ihe conditions listed in Table I. 
Typical relative standard deviation values calculated for six 
rims were below 1% in migration time and below 3% in peak 
area. 

Test Parameters 

The metrics collected in the final testate Ihe reproducibilities 
(relative standard deviations) of the measured migralion 
limes and peak areas of the well-denned vitamin samples. 
The instrument parameters implicitly tesled by determining 
lime reproducibility are the slability of the cassette 
lempcralure and Ihe accuracy of the replenishment system. 
The entire injection and detection system is tested by the 
determination of area reproducibility. Of course, tile basic 
inslnimeiil ft it id ions like Hay and lift movements need lo 



work correctly during die final test for any results to be 
obiaine<L 

Time and area reproducibility depend not only on instrument 
parameters, but also strongly on chemical and physical in- 
fluences. For testing instrument functions, the test tool, 
which is the vitarnin analysis in litis case, should have 
constant parameters, ideally with no failure possibilities. 
However, variations and failures of chemical systems can- 
not be excluded. Therefore, failures and their impacts have 
to be well-known to distinguish between chemical and 
instrumental failures. 

Tables II and III show instrumental and chemical/physical 
parameters having direct influences on migration time and 
peak area- 
Time Reproducibility 

lite most important parameters influencing the migration 
time reproducibility Of separations carried out in bare fused 
silica capillaries are variations in die eleetroosniotic flow 
and the degree of equilibration of the silica surface with 
respect to the buffer. 

The Snioluchowski equation describes the parameters deter- 
mining the eleetroosniotic mobility: 

E0Er? 

v eof yj Heof**. 

where vqof is the eleetroosniotic velocity, eg is the permit- 
tivity of vacuum, e r is the permittivity" of the electrolyte solu- 
tion, c is the zeta potential, n is the viscosity of the electro- 
lyte solution, ukok is the eleclroosmotic mobility, and E is 
the electrical field strength. According to the Snioluchowski 
equation, Ihe eleetroosniotic flow is influenced by the zeta 
potential, which is affected by the properties of the fused 
silica material. The eleetroosniotic flow is also affected by 
the ci imposition and pi I of the buffer and the precondition- 
ing solution. 



Table III 

Factors Influencing Peak Area Reproducibility 

Instrument Parameters 

Injection System 
Pressure 
Valves 

Detection System 

Chemical and Physical Parameters 

Expulsion of Sample 
Single-Step Injection 
Injection + Postinfection 
Voltage Ramp 

Reproducibility of Injection Plug 
Injection Volume 
Zero Injection Effect 

Time Reproducibility 
t ■ absorbance 
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pH and Concentration of Conditioning and Preconditioning 
Solutions. Fused silica capillaries are drawn under highly 
dehydrating conditions of high temperatures (around 1600 V) 
and dry inert gas (argon ). When a capillary is treated with 
aqueous conditioning solutions the first time before use, 
silanol groups are created, a gel layer at the silica/liquid inter- 
face is developed, and the electrical double layer is built up 
( in the case of untreated fused silica, this consists of nega- 
tive charges on the capillary surface and positive charges in 
the liquid near the surface, as explained in I he article on 
page 6). 

In general, NaOH flushes al elevated temperatures are used 
for conditioning, resulting in a maximum surface density of 
charged silanol groups. NaOH is known to dissolve fused 
silica strongly and is therefore expected to have the best 
cleaning effect on the surface. On the other hand, the use of 
NaOH is a very severe method that is expected lo leave a 
rough surface which could create eleetroosmotic flow varia- 
< ii ins and local eddies. This can decrease the separation effi- 
ciency. 2 The impact of NaOH is not entirely dear at this lime 
and I he subject is still under ongoing research. 

Acidic solutions like phosphoric acid are also used for 
conditioning, especially when the subsequent separation is 
carried out in acidic buffer media. 

Before every run, capillaries are normally preconditioned 
for the subsequent separation for cleaning and equilibration 
purposes. This step can consist just of one buffer Hush bul 
often includes several steps with different flush solutions. 
Preconditioning solutions that differ from the run buffer 
influence the stains of the surface. For example, when 
NaOH flushes followed by run buffer Hushes are used for 
the vitamin analysis, the resulting eleetroosmotic flow and 
surface condition arc different tftan if only run buffer is used 
for preconditioning. In general, the eleetroosmotic flow is 
higher using NaOH Hushes. In such cases, the surface is in a 
quasistable state and not in an equilibrium state. 

Buffer pH, Concentration, and Type. The separation buffer af- 
fects the density of charged groups and the electrical double 
layer at the surface as well as the Ihickness and composition 
of the gel layer. 

The type of buffer determines the equilibration behavior of 
the surface and the buffer. Phosphate buffers especially are 
known to have a slow equilibration behavior because 
phosphate migrates into and out of the bulk silica, continu- 
ously changing the zeta potential of the wall as long as 
migration takes place. 3 -" 1 Using phosphate buffer al low pi I 
afler initial NaOH cleaning, surface equilibrium adjustment 
times over 20 days can be observed. For citrate or borate 
buffers, the migration mechanisms as described for phos- 
phate are not known. Equilibration seems lo occur faster 
with those buffers. 

Fused Silica. The manufacturing of capillar>' material and the 
process of capillary production are expected to have an im- 
pact on the zeta potential of the surface. The type and mag- 
nitude of the influence of these parameters have not been 
clarified yet and are still under ongoing research. 



Area Reproducibility 

Besides the reproducibility of the injection pressure and 
voltage, which are instrument parameters, the type of injec- 
tion procedure tS one of the important factors that determine 
area reproducibility. The zero injection effect (explained 
later) has a similar- influence on area reproducibility. 

Type of Injection. The most common injection procedure is just 
to inject a sample plug of a certain length either by voltage or 
pressure. For better reproducibility, the sample introduction 
can be combined with an additional buffer plug injection 
(postinjeclion ) with or without a voltage ramp to start the 
separation. 

Theoretically, the following considerations apply. When a 
separation voltage is applied to a capillary after injection, a 
heat pulse is created. This results in the volume expansion 
of the buffer- and sample in the capillary. Volume expansion 
causes liquid to be pushed out of the capillary. If the sample 
plug is located directly at the end of the capillary, some sam- 
ple is expelled. This process is a cause of low reproducibil- 
ity. Under the conditions in which the vitamin analysis is 
carried out. this cffeci has hern calculated to have a minor 
impact. 5,(1 Experiments (described later) have shown that 
the geometry of the capillary end is much more important. 
Even if the capillary has an accur ately cut rectangular edge 
and the polyimide is burned off at the ends, the microscopic- 
edge properties differ from capillary to capillary. In addition, 
physical inter actions between the surface tension of the 
liquid and the pr operties of the inner and outer surfaces of 
the capillary contribute to the inconsistency of injected arrd 
expelled sample amounts. These deficiencies of the capil- 
lary ends can be overcome by the intr oduction of a buffer 
plug after the sample plug, as confirmed in the experiments. 

Zero Injection Effect. All inject ion procedures are subject to 
the zero injection effect. Zero injection is caused by capil- 
lary forces when a capillary is immersed in liquid. Reproduc- 
ibility is mainly affected by the interaction of t he surface 
tension of the liquid and the capillary inner and outer sur- 
faces, and by the inner diameter and length of the capillary. 

For a capillary with an inner diameter of 50 urn and a total 
length of 48.5 cm, the amount of zero injection plug can be 
expected to be around 0.2 mm. This amount is added lin- 
early to each injection plug. The influence of the zero injec- 
tion effect decreases with increasing injection plug length, 
but increasing the injection plug length strongly decreases 
the efficiency of every peak. Efficiency and aero injection 
are opposite effects. A general rule says that the injection 
plug length should not exceed 1% to 2% of the total capillary 
length. 1 

Reproducibility Tests 

To examine the exact influence of zero injection and injec- 
tion type, a test suite was set up consisting of four different 
three-\itamin analyses. The conditions, except those for 
injection, were held constant and were the same as used in 
the final test procedure. The exact injection conditions are 
described in Table IV. Fig. 1 shows the uncorrected absolute 
areas of all three vitamin peaks (thiamine, nicotinamide, and 
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Table IV 

Injection Conditions for Four Three-Vitamin Analyses 



Method 

1 

- 

3 
4 



Injection Time 
(mini 

4.6 

2 



Injection 
Pressure (mbari 

40 

40 

40 

zero 



Postinjection 
Time (mini 

4 

no 

no 

4 



Postinjection 
Pressure Imbarl 

40 

no 

no 

40 



Voltage Ramp at 
Separation 

no 

2.4 s'20 kV 
no 
no 



Sample Plug 
Length (mm) 

2.9 

1.3 

1.3 

zero injection 
plug: 0.2 



nicotinic acid). Fig. 2 shows tlie relative standard deviations 
of the peak areas shown in Pig. L The method numbers in 
Fig. 2 correspond to those in Table IV, Six repetitions of 
each method (injection type) were carried out for the rela- 
tive standard deviation calculation. In addition, the lest set 
of the four injection types was repeated four times to show 
the reproducibility of each. 

As expected, the highest relative standard deviation was 
calculated for zero injection. Typical relative standard devi- 
ation values were around 1396 to 20%. Comparing the test 
conditions, Ihe best reproducibility, with relative standard 
deviation values smaller than 396 in all repetitions, was real- 
ized using the postinjection procedure (method 1). As ex- 
pected, postinjection was the best means of overcoming the 
disadvantageous impact of the many different forces at the 
capillary ends. Using no postinjection but a linear voltage 
ramp of 20 kV in 2.4 seconds led to a failure range of around 
5% relative standard deviation. As expected from theory."' 1 '" 
the voltage ramp showed minor impact in that case. 

Final Test and Results 

Tin' final test procedure was chosen on the basis of the above 
tests ;m<l considerations to minimize the effects of the factors 
that ill-grade migration lime and peak area reproducibility. 

At the beginning of Ihe lest procedure (he capillary is 
Hushed with IM and 0.1M Nat »H and run buffer (capillary 
conditioning ). independent of whether the capillary is being 



used for the first time or has been stored in buffer for a 
longer period of time. Afterwards. 26 vitamin separations 
are carried out for each test. The first 18 runs are for equi- 
libration of the capillary to an acceptable degree. The nine- 
teenth run is used as a calibration run for the reproducibility 
report. From the following six runs, calculations for time 
iuul area reproduc ibility are done. Injection is carried out in 
a two-step procedure consisting of a sample injection by 
pressure followed by a postinjection of rim buffer, also by 
pressure. From a statistical point of view the total number 
of tesl runs (25) gives a high enough probability that any 
instrument failure will be discovered. 

Time Reproducibility. Why new capillaries have to be condi- 
tioned before first use can be directly inferred from the 
theoretical aspects described above. Cleaning and the cre- 
ation of high electroosmotic flow are the main reasons. But 
the capillary conditioning with 1M NaOH also has to be car 
lied out for capillaries stored in buffer. Theory leads to the 
expectation that storage in buffer over several days should 
result in an equilibrium stale of the surface. However, if the 
capillary is used directly after storage, a bigger and longer 
electroosmotic How drift during lest separations is observed 
compared to the drift obtained after the conditioning ineihod- 
with 1M NaOH. Probably, Ihe preconditioning with (I.1M 
Nat ill before every run destroys the equilibrium reached dur- 
ing the COntacI With buffer only. But elimination of the 0. 1M 
NaOli flushes before every run leads to a worse peak shape 




Method Number 



Fiu. I. PeaJ areas for thiamine 
(peak I ), nicotinamide (peak 2), 
and nicotinic iici'l (pe&k 3) using 

the four methods (injection 

types) described ill Table IV. Six 

runs were clone using each 

method ;ind the entire sequence 
was repeated four times. 
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Peak t 
Peak 2 
Peak 3 



4 1 2 
Method Number 



Fig. 2. Relative standard devi- 
ations of peak .irons for thiamine 
(peak 1 ). nicotinamide (peak -). 
and nicotinic acid (peak 3) using 
[ho four methods (injection 
types) described in Table IV. Six 
runs were used for the relative 
standard deviation calculation for 
ouch method and the entire se- 
quence was repeated four limes. 
The final test procedure for the 
III' CE instrument uses method 1 



for thiamine after a certain number of runs. In our tests, the 
best stability was reached by carrying out the capillary condi- 
tioning method once before the start of every test, followed 
by analysis procedures consisting of preconditioning with 
O.I.M NaOH arid then run buffer, and finally separation. 

Even when this procedure is used, the capillary needs l-i to 
2(1 tuns until stable enough conditions are established to en- 
sure highly reproducible migration limes. The procedure 
was verified in a series of five test sequences carried oul 
using different capillaries. Figs. 3 to 5 show the migration 
times of the three vitamins thiamine, nicotinamide, and nico- 
tinic acid plotted against the run number. Nicotinamide, the 
noncharged molecule, is only transported by eleclroosmotic 
flow. Therefore. Ibis molecule can be used for the deter- 
mination of eleclroosmotic flow. Figs. 3 to 5 dearly show 
variations within the first 15 to 20 runs which led to the 



deviations in migration limes of all three test molecules. The 
impact of eleclroosmotic flow on negatively charged ions is 
mUCh greater than on positively charged ions because nega- 
tive ions migrate against the electroosmotic flow, so the 
influence of a fluctuating electroosmotic flow is much 
larger. This effect can be also deduced from Figs. 3 to 5. 

Figs. 3 to S also show a comparison of the migration limes 
Of different sequences run with different capillaries. Differ- 
ences between absolute values of eleclroosmotic flow for 
different capillaries are obvious. Electroosmotic flow varia- 
tions up to 7% from capillary to capillary and up to 2(1% from 
batch to batch of bate fused silica could be observed. This is 
a well-known phenomenon described in the literature. ' s 

[)p to 1000 vitamin analysis runs can be carried out with a 
bare fused silica capillary treated as described above. In 
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Fig. 3. Migration times for thia- 
mine during the final test proce- 
dure for the HP CE instrument. 
The five plots are for five differ- 
ent capillaries. 
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Fig. 4. Migration times for nico- 
tinamide during tin 1 final test pro- 
cedure for the HP (,'E instrument. 
The five plots are for five differ- 

••iii capillaries, 



general, a long-term drift to higher electroosniotic How has 
been observed in long sequences. 

Area Reproducibility. The injection procedure in the final test 
consists of two sleps: the sample injection using the pres- 
sure mode is followed by a post inject ion of run buffer by 
pressure as well. Both the sample plug and the buffer plug 
have a length of 't mm. This plug length is a compromise 
between minimizing the zero injection effect and maximiz- 
ing separation efficiency. 

Another very important aspect for area reproducibility is the 
choice of the outlet vial during the injection procedure. The 
outlet home vial, which is the run buffer vial for the separa- 
tion, has to be in position at the stall of sample injection and 
must not be changed after sample injection. If the capillary 



outlet end is taken out of one vial and immersed into an- 
other, physical forces like surface tension of the aqueous 
liquid, inside and outer surface properties of the capillary, 
and pressure differences can cause the contents of the capil- 
lary to move. This can lead to either introduction of air or 
expulsion of liquid (sample) at the inlet side, the other end 
of the capillary. Like zero injection, this effect is hard to con- 
trol and results in very high (failing) relative standard devi- 
ations. This problem is avoided by positioning the outlet 
home vial for all separations before injection. 
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The Impact of Column Technology 
on Protein Analysis by Capillary 
Electrophoresis: Surface Coatings and 
Analytical Approaches for Assessment 

To avoid unwanted interactions between proteins being analyzed and the 
surface of the fused silica CE capillary, the surface must be deactivated. 
Four approaches to surface deactivation for protein analysis are 
presented. A method for determining the extent of protein adsorption is 
discussed. 

by Sally A. Swedberg and Monika Dittmann 



In 19S6. Henk Lauer and Doug McManigill of HP Laborato- 
ries published an article on the capillary electrophoresis of 
proteins on untrealed fused silica. 1 In mi attempt to solve 
the problem of untoward interactions of protein solutes with 
the high-energy fused silica surface, they look the approach 
of using organic additives in the electrolyte solution to deac- 
tivate the surface dynamically. They concluded that the ap- 
proaches taken for dynamic deactivation were limiting for 
protein analysis in general for a variety of reasons. In con- 
clusion, they wrote that "... the development of chemically 
bonded wall deactivators remains an important topic" 

To give some insight into the impact of this study, it is im- 
portant to understand what impact the CE project at HP 
was perceived to have at this lime. Because of a number of 
publications by -I.W. Jorgensou and others,- CE was 
thought to have the potential to revolutionize the way anal- 
ysis of biopolymers would he done in the future. Therefore, 
protein analysis by CK was considered extremely signifi- 
cant. The conclusion of Lauer and McManigill that still 
more work on the capillary chemistry needed to be done to 
provide routine analysis across a range of protein samples 
drew new attention to research on coating chemistries for 
surface deactivation of fused silica capillaries. 

This article describes research at IIP Laboratories anil the 
Waldbronn Analytical Division on coating chemistries ef- 
fective for protein analysis by CE. 



In Search of the Biocompatible Surface 

Based on biophysical studies of the interactions of proteins 
at interfaces, it is known that one attribute of a surface that 
is necessary for reversible protein/surface interactions to 
OCCur is that the surface must be highly hydraled. Though 
this condition is necessary, it is not sufficient. Further, 
selection rules for surface attributes that promote revers- 
ible, low protein/surface interactions are not well-under- 
stood. The complexity of the heterogeneous polymer 
known as the protein makes rational approaches to such 
selection rules quite difficult. In addition, the (iibbs free-en- 
ergy interaction term for protein/surface interactions Lsalso 
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Fig. 1. ghftlM pIQfile of Seven protein markers and DMSOon (a) an 
arylpeiitafluoto-ticateil column and (l>) an untreated fused silica col- 
umn. Conditions: 200 rnM phospliale, 100 iiiM KCL solution, pfl 7, in 
2U-|iiii capillary lulling Using an applied voltage of 250 V/cAl Detec- 
tion: on-column PV at nrn. Length or column to detection: lull 
cm Peaks: L = lieu egg while lysnzyme, I) = PMSO, H = bovine riho 
nuclease A. T = bovine pancreatie trypsiiuigen. VVM = whale myoglo- 
bin, HM a horse myoglobin, HCA-B = human carl ionic anhydra.se B. 
HCA-B = bovine carbonic anhyiliusc H (Reprinted from reference.'). 
■ I'lliil Aeaileiiui Press Reproduced with permission ) 
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Fig. 2. Comparison of CE analysis on a bovine serum albumin modified capillary with HPLC analysis for (a) trypsin inhibitor, (b) ovalbu- 
min, (e) a-ebymoti-ypsinogeii. Willi respect to the resolution of the number of species in the commercial protein preparations, the t wo 
methods appear to be macroscopically comparable, overall. In the case of trypsin inhibitor. CE separated more components than HPLC. For 
ovalbumin. HPLC gave more indication of the microheterogeneity in the major peak for Litis glycoprotein. For H-chyniotrypsinogen, lite 
leading shoulder peak of the major peak appeared to be more clearly resolved by LC. The total analysis time Was considerably shorter for 
CE. Even in the case of u-chymolrypsinogen, CE does not require the reequilibrut.ion lime required for reverse phase M.' columns. 



dependent on the solvent conditions used during analysis, nol 
just on the chemistry of the surface alone. 

Solving the problem of untoward protein/surface interactions 
requires both insights into biocompatible surfaces and a 
means for assessing die best solvent conditions in conjunc- 
tion with a suitable surface. The next section gives an over- 
view of some of die work done at UP Laboratories on surface 
coatings for analysis of prot eins by CE. Then, work done at 
the Waldbronn Analytical Division to develop an analytical 
lool for assessing I he extent of protein/surface interactions 
under various conditions is described. The specific example 
of a very promising surface, polyethylene glycol, is presented. 

Surface Modified Capillaries 

Arylpentafluoro Modified Capillaries, Fig. la shows the separa- 
tion of seven protein standards on an arylpentafluoro-treated 
surface. This was one of the first stuTace modifications tried, 
and was based on attributes that were known from affinity 
and hydrophobic interaction chromatography (HIC) lo be 
desirable for reducing protein/surface interactions.' 1 Shown 
in Fig. lb is die control, in which the same protein sample 
was run on a fresh fused silica surface. This separation, 
which is the result of untoward protein/surface interactions, 
is illustrative of the problems frequently encountered in the 
analysis of complex samples of proteins by CE on unmodified 
fused silica surfaces. .As can be seen from the conditions, 
fairly high concentrations of phosphate buffer arc required 
Tor this analysis. The second paragraph below discusses how 
die prolonged contact of phosphate widi the silica surface 
produces an interesting surface modification dial is also pro- 
tein-compatible. 

Bovine Serum Albumin (BSA) Modified Capillaries. F'ig. 2 shows 
examples of protein samples analyzed by borh CE and high- 
performance liquid chromatography (HPLC ). 1 There are two 



interesting features of die BSA surface for the purpose of 
protein analysis. First, it is a highly hydrated surface, which 
in part explains t he low sorptive nature of a variety of pro- 
teins to this surface, even at very low ionic strengdi of the 
buffer (TO mM citrate, in these examples). Second, since 
proteins are amphoteres, it displays a siginodal electroos- 
motic How profile as a function of pH (Fig. 8). It is there- 
fore possible to tune both the magnitude and the direction 
of the electroosmotic How as a function of the pH of the 
solution. The impact of this feature is demonstrated in 
Fig. 3. 

Phosphosilicate Modified Capillaries. In 19S8, McCormick 
demonstrated that with prolonged contact with phosphate 
buffers, a stable phosphosilicate surface is formed." He 
demonstrated that successful protein separations could 
be done in fused silica capillaries after the phosphosili- 
cate surface had been formed. His work was done al pH 2, 
which is an undesirable pH for many proteins, promoting 
denatttration and aggregation. Based on his studies, other 
groups have demonstrated that this approach can be used 
across a wide range of pH (Fig. 4 ).''•• Fun her, since these 
surfaces form readily, thereby obviating the need for spe- 
cially manufactured capillaries, tiiis is a useful method for 
protein analysis that can be easily integrated into the biosci- 
ence laboratory. 

While physical means for assessing the extent of protein/ 
surface interactions were used in conjunction with the sep- 
arations discussed above. s a more robust approach using 
frontal analysis was developed at Waldbronn. This frontal 
analysis approach was used to assess still another promis- 
ing surface, polyethylene glycol. That study is described in 
the following section. 
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Polyethylene Glycol Surface Coalings 

in 1989, the ffaldbtorm Analytical Division became involved 
in die development of biocompatible coatings for die ( F, sep- 
aration of proteins. As previously mentioned, a surface that 
provides reversible prolein/surface interactions nuisi he 
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Fig. 4. Effects of sodium sulfate anil ammonium sulfate on the sepa- 
ration of five protein standards. Buffer = 150 mM phosphate, pH 7J0, 
with la) 860 mM sodium sulfate al 1 1H microamperes and (b) 21)0 
mM ammonium sulfate at 138 microamperes. (Conditions: 15°C, 400 
V/cm, L = 49.5 em, L, IN - = 4 1 cm. Peaks (left to riglil ): rihonuilctLse, 
myogloliiii. B-larioglolniliii A, trypsin inhibitor, IS-lacioglolinlin B. 

highly hydrated. < toe class of materials that fulfill litis condi- 
tion is the class of hydroplulic polymers known as polyethyl- 
ene glycol polymers. Polyethylene glycol polymers as surface 
coatings are known to have little interaction with proteins.' 1 
l'olyeth\ lone glycol coated capillaries have long heen avail- 
ahle for gas chromatographic separations. This type of coal- 
ing was lesled at Waldhronn for feasibility in the separation 
of proteins. 

Determination of Protein Adsorption 
hy Frontal Analysis 

A method thai allows dhreel determination of the adsorption 
or a solute on a surface is frontal analysis. Frontal analysis 
is essentially a chromatographic method for measuring the 
amount of protein adsorbed and the strength of the protein/ 
surface interactions. A solution of the protein of interest is 
ptmtped through the coated capillary and the breakthrough 
of the protein front is observed (Fig. 5). The amotrnl of pro- 
tein adsorbed al the surface under given conditions ran be 
calculated from: 

«!(«•) = c(V r - V d )/A,. 

where ti(c) is the amount of protein adsorbed per anil area, 

c is the concent rat ion of protein, Vj is the releniion volume 

of the protein from i now rate times Detention time ofthe 
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Fig. 5. Example of a frontal anal- 
ysis curve- of a mixture at dmso 
(dead Volume marker) and cy> 
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Fig. 6. Adsorption isotherms for (a) cytochrome C and (b) iysozyrae 
on an uncnated fused silica capillary. Buffer: 0.02M NaHoPO^, pH 
7.0. plus 0 USM NaCl and U.23M NaCl. 



protein front ), V,| is the capillary dead volume (flow rate 
limes retention time Of the marker front ). and A s is (he 
inside surface area of the capillary. 

If'q(c) is determined for a number of different protein con- 
centrations, an adsorption isotherm is obtained. For many 
solutes, these adsorption isotherms are of the Langmuir type 
and can be fit to the equation: 

q(c) = ac/(l + be), 

where a is the slope of the isotherm at low concentration 
and b is an empirical parameter. The parameter a is related 
to the retention coefficient k' by the equation k' = ah\ where 
fi is the phase ratio. 

If adsorption isotherms of proteins are determined under 
different conditions (temperature, solvents, buffer concen- 
trations, etc. ) conclusions can be drawn its to the type and 
strength of protein/surface Interactions. In this regard, 
proper separation conditions can be determined from 
frontal analysis experiments. 

Adsorption isotherms of lysozyine and cytochrome G on an 
uncoated fused silica capillary at two different salt concen- 
trations in the buffer (O.OSM NaCl and 0.23M NaCl) are 
shown in Fig. 6. An increase of sail concentration reduces 
both the maximum amount of protein adsorbed at the sur- 
face and the initial slope of the isotherms at low protein 
concentrations. This indicates the presence of electrostatic 
protein/surface interactions on the uncoated fused silica 
surface thai are suppressed by the addition of NaCl. Fig. 7 
shows adsorption isotherms of lysozyme and cytochrome C 
on a polyethylene glycol coated capillary with no NaCl 
added to the buffer. On this surface, the amount of protein 
adsorbed is very small, indicating that this surface might be 
suited for protein separations. An addition of 0.03M NaCl 
completely suppressed proiein adsorption on this surface. 

Fig. 8 shows a separation of four proteins that cannot be 
eluted from an uncoated capillary unless a high pll or a very 
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Fig. 7. Adsorption isotherms of lysozyme and cytochrome C on DB- 
WAX rapillary at low protein concentrations. Conditions: 20 mM 
NaH-jK)4, |>H 7, 25°C. 

high sail concentration is used in the eluting buffer. • )n the 
polyetliylene glycol coaled capillary, a highly efficient sepa- 
ration can be obtained under moderate conditions. 

Further studies concerning the stability of the coaling and 
separation of real-life samples are under way. 
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A New High- Sensitivity Capillary 
Electrophoresis Detector Cell and 
Advanced Manufacturing Paradigm 

By circumventing laminar flow while expanding the cross section of the 
analyte, this detector cell greatly increases both the sensitivity and the 
linearity of capillary electrophoresis. Manufacturing is made feasible by 
an advanced computer-controlled miniature lathe using machine vision. 

by Gary B. Gordon, Richard P. Telia, and Henrique A.S. Martins 



Capillary electrophoresis (CE) is a powerful and relatively 
new analytical technology used to separate and help identity 
complex aqueous mixtures of chemical and biological sam- 
ples (see article, page 6). However, CE has often been char- 
acterized as a wonderful technology thai is scaled too small. 
This criticism arises from the practical requirement to use 
very small capillary and sample sizes, which compromises 
sensitivity. Thus sensitivity is often the most important spec- 
ification researchers use when comparing CE instruments. 

Small Capillaries, Big Headaches 

Capillaries for CE are usually 75 micrometers or less in inside 
diameter. With larger diameters, several adverse factors come 
into play. First, for a given electrical field, increased diameter 
means more internal heating in the electrolyle filling the 
capillary, causing an increased temperature rise. Second, the 
radial thermal conduction path, by which heat is dissipated, 
increases in length. As a result, the temperature at the center 
of the capillary rises even further. This causes a viscosity 
gradient, which allows molecules of the same species near 
the center to migrate faster, thus spreading the bands unnec- 
essarily. As a practical compromise, a 50-micrometer inside 
diameter capillary offers a reasonable balance bet ween 
sensitivity and resolution. 

Sensitivity can be increased somewhat by injecting larger 
samples. But beyond a point, this practice is undesirable 
since il degrades resolution and broadens the peaks. For 
most users, the width of the injection is purposely kept nar- 
row- enough so that its contribution to peak broadening is 
perhaps 10% or less. 

The shape of the peak at the detector is characterized by the 
mathematical conv olution of three contributors: the rectan- 
gular injection plug, the Gaussian impulse response of the 
separation capillary, and the shape of the illuminated volume 
of the detector. Each contributors spread can be character- 
ized by its variance, a measure of the square of its width. The 
variance of the detected peak is t he sum of the variances of 
the injection, the capillary, and the detector. 



In practice, a typical injection might be one milhmeter long 
and, when spread by diffusion during separation, might pro- 
duce peaks around 4 mm wide. Such an injection contains 
only 2 nl of sample. 1000 times less than with liquid chroma- 
tography. If the sample contains only one ppm of the constitu- 
ent of interest, the amount of this constituent that reaches the 
detector is truly minuscule. 

Conventional CE Detectors 

CE detect ors usually measure UV absorbance. The problem 
becomes one of efficiently probing or illuminating the band 
of sample constituent carried in the transparent electrolyte. 
With 4-nuu-wide peaks, a designer might choose to probe a 
volume of electrolyte 1 mm long to avoid excessive peak 
broadening. 



A second important requirement of detectors is that they be 
able to quantify peaks accurately, that is. they must be linear. 




Fig. I, Inspiration from a 1903 handbook on glass (flowing (front 
RN. Hasluck, Glass Working by Ileal and by Abrasion , Reprinted 
by Lindsay Publications, L989J Used with permission). 
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Fig. 2. Manual miiroglass lathe used fur initial prototyping. 

To accomplish this, as much of t he illiiinination as possible 
should pass through the center of the capillary, and especially 
not travel as stray light around its edges. The intuitive reason 
for this requirement is that at high absorbencies less light 
makes it through the analyte, while stray light remains con- 
stant and becomes proportionally an increasingly .significant 
contributor. Thus, further decreases in the already weak light 
passing through the analyte result in lcss-t hail-proportional 
changes in the total light received by the photodiode or 
spectrophotometer, that is, the detector becomes nonlinear. 

Conventional ( E detectors attempt to pass illumination 
radially through the capillary walls, focusing or aperturing the 
light as well as possible to pass the rays through the center. 
This configuration is fraught with problems. First, the absor- 
bance path length is so short (the inside diameter of the capil- 
lary ) that the signal is small and the sensitivity poor. Second, 
the laws of physical optics prevent most of the deuterium 
UV excitation lamp's energy from being focused into such a 
SRia]] region, so fewer photons reach the detector and the 
shot noise increases. Third, it is virtually impossible to pre- 
vent stray light from escaping around the capillary inside 
diameter, so the linearity is poor at high concentrations and 
quantification is inaccurate. 

Lengthening the Path 

To obtain a longer absorbance path length, it is tempting to 
imagine ways of probing the sample volume axially, such as 
with a Z-shaped Cell, since it would better match the long 
aspect ratio of the bands. The benefit would be a path length 



of hundreds of micrometers, compared to one 50 microme- 
ters long as in the foregoing example. The path length, how- 
ever, cannot be the full 1-mm length of the probed volume as 
might be expected, since the light rays spend most of their 
time traversing the capillary walls as they zigzag off its pe- 
riphery. One author briefly considered litis option early on 
but rejected it because of poor linearity, liigh cost, and mod- 
est sensitivity gains. 

Given the above difficulties, what other techniques might be 
used to increase the path length? Would radial expansion to 
form a bubble be feasible in a capillary not much larger titan 
a human hair".' If so. what might l>e the mixing consequences? 
These were the starting thoughts for the HP design, influ- 
enced by remembrances such as the glassblower sketch. 
Fig. 1. 

To explore the nature of microglassblowing. first a CO2 laser 
was tried, with unpleasant results (the capillary pitted and 
fractured). Next a small battery-powered glass lathe was 
constructed (Fig. 2.). Commercial pin vises were adapted to 
form headstock and tailstock clamps, which supported the 
capillary on both sides of what would become the detector 
cell. A small syringe, which rotated with the lathe, was used 
to apply an air pressure of several bar to one end of the cap- 
illary. The other end of the capillary was left open and al- 
lowed to spin freely. Fused silica softens at a very high tem- 
perature (1500 ; C), but a hobbyist miniature oxyacetylene 
torch worked very well for applying pinpoint heat. A stereo 
microscope facilitated watching the bubble growth prog- 
ress. With this lathe, blowing the bubble cell proved to be 
relatively easy, despite some dire predictions. In fact, an 
important component of selling the project was having man- 
agers try it themselves. 

The Bubble Cell: 

Laminar Flow, Plug Flow, and Serendipity 

The core issue and more interesting science came to play 
when we began to consider what would be the nature of 
fluid How in the cell. The first intuition was that the cell 
might represent a mixing volume, with either laminar or 
turbulent flow. With laminar Row. the velocity profile devel- 
ops a parabolic cross section, with the innermost portion of 




Fig. 3. Microphotograplt of the plug flow front, <onfirming tin- ab- 
sence of mixing. 
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Fig. 4. Electrical Geld model of the cell. 

the si ream moving Hie fastest, and shear smoothly reducing 
the velocity at the walls lo zero. Within this regime mixing 
and hand broadening are considerable. A second and pre- 
ferred form of flow in I he cell is turbulent How. With this 
form of flow, the cell can be thought of as a vessel thai is 
repetitively partially refilled, mixed, and then partially re- 
emptied. With I urbulent flow. ( 1 — 1/e) or 63% of the volume 
is swept out with each complete refill. This is the regime 
used in liquid chromatography detectors, which are. of 
course, pressure-driven. It is not perfec t, because the cell 
size must be much smaller than desired so as not let broaden 
the peaks excessively. As a consequence of the small cell 
size, the detector's sensitivity suffers. 

As the project progressed, it became evident that a serendipi- 
tous How balance in the cell might be conceivable. I iilike LC. 
the CE electrolyte is not driven through the cell by pressure, 
but rather propelled at its edges by the same electroosmotie 
forces that drag the electrolyte through the separation capil- 
lary. These forces might be reasoned to be less in the cell 
than in the capillary.. just at the same time that the bulk flow 
requirements in the widening cell would require velocities 
that were decreasing. 

Electroosmotie How theory teaches that the forces that pro- 
pel the electrolyte through the capillary act at the thin pe- 
riphery of the fluid, across a region just micrometers thick, 
known to electrochemists as the double layer. These forces 
act to shear this double layer, producing a velocity near the 
edge that is proportional to force and therefore proportional 
to the axial electric held. Since the axial field is much lower 
in the cell because of the greater conductivity of its enlarged 
cross section, the v elocity near the edge of the cell drops 
dramatically from that in the unexpanded portions of the 
capillary. 

When the electrolyte enters the bubble cell, it encounters a 
gently increasing cross section. Since the fluid flow is in- 
compressible, the average velocity in the cell drops in in- 
verse proportion to the cross-sectional area. Now. if the ve- 
locity at the edge of the cell should also drop in proportion, 
there would be no tendency for mixing in the cell and the 
How would be of the highly desirable plug nature. 

This is. in fact, exactly what happens (see Figs. 3 and I ). 
Both the velocity at the edge of the cell, wliich drags the 



contents, and the contents of the cell slow down in exact 
proportion. This remarkable result means that unlike LO. the 
flow in the CE bubble cell is of plug nature, without any 
additional dispersion whatsoever. Thus cells proportional!) 
larger by nearly an order of magnitude than for LC can be 
used, and much of the sensitivity losi because of the smaller 
CE apparatus is regained. It is as though the sample plug, 
long and skinny in the capillary, both slows and transfigures 
itself into a disc upon entering the cell, thus making possible 
much higher analysis sensitivity. Subsequently, upon exiting 
the cell, the plug retakes its original form and speeds along 
its way. 

Fig. 3 shows a photomicrograph of the cell with the front of 
a separation band passing through it. Although the analyte's 
constituents continue to separate in the cell as they do in 
the separation column, the nature of the flow in the cell is 
dominated by the aforementioned electroosmotie flow. 

The cell might, at first, appear lo behave simply like a very 
large capillary and be vulnerable lo radial heating, radial 
density gradients, and counlerflow. which cause disastrous 
band broadening in large capillaries. This is not the case, in 
part because the the axial power density in the cell is a tiny 
fraction of the axial power density in the separation portion 
of the capillary. Further, any eounterflow that might tend to 
develop is small because of the low field and the relatively 
short time the constituents spend in the cell. 

In practice, a typical bubble cell might have a diameter three 
times that of the capillary within which it is formed. It is then 
said to have a bubble factor ( 13F) of three or 3>c In a 3x cell 
the osmotic velocity is one-ninth that in the separation region 
of the capillary. Peaks compress in length by a factor of 
nine, with a 4-iuillimeler-wide peak shrinking lo only 44(1 
micrometers. 

How Sensitive? 

The sensitivity gain of the bubble cell comes from two con- 
tributions: increased signal and less noise. Signals increase 
in direct proportion to the increase in the length of the ab- 
sorbance path, which is equal to the bubble factor. We as- 
sume that the modem deuterium lamp is itself not a signifi- 
cant source of noise. Rather, the dominant noise derives 
from the randomness of the photons reaching the detector. 
Such "shot noise." as it is known, is proportional to the 
square root of the flux. 

As an example of the potential sensitivity gain, consider a 
2.5x cell compared to a straight 50-um capillary. For maxi- 
mum light flux and minimum stray light, assume that the 
round source of a deuterium lamp is demagnified and 
imaged directly onto the analyte. The signal increase is 
equal to the path length increase, which is equal to the 
bubble factor, 2.5. To calculate the decrease in noise, it is 
necessary to know how much the flux increases. Allowing 
a 10% margin at each side of the cell to minimize stray light 
effects on linearity, the beam diameter in this example 
could be increased from 40 urn to 100 jam. or a factor of 2.5. 
Since the flux increases by the square of the diameter, and 
the noise drops by the square root of the flux, the noise 
simply drops by the same bubble factor of 2.5. The signal- 
to-noise improvement is equal to the product of the path 
length increase and the noise reduction factor. Since each is 
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Fig. S. Nomograph rhamrtenzmg 
a bubble cell detector Illuminated 
with a round illumination cone of 
optimized size and constant in- 
tensity For u given capillary size 
and equivalent sampled length 
Un,, an optimum bubble factor is 
indicated and the sensitivity im- 
provement is predicted The dot 
at a capillary diameter of 50 urn 
ami L,,, = 3 mm uwlicates param- 
eters commonly used in the CE 
literature to compare high-scnsi- 
tivity detectors. 



itself equal to the bubble factor, the signal-to-noise increase, 
or sensitivity gain, is simply the bubble factor squared, or 
6.25x in this example. 

Fig. 5 is a nomograph show ing to the first order how several 
parameters are affected when a bubble is added. It assumes 
imaged illumination as above, but neglects the 11)% margins. 
The dotted lines indicate the size of the sampled volume, as 
measured by an equivalent length Lp,, of an analyte plug in 
the unexpanded capillary. For the above 2.5x cell example, 
the equivalent sampled length is seen to be 0.8 mm. a length 
unlikely to contribute noticeable peak broadening. Equiva- 
lent sampled lengths larger than roughly a third of the length 
of the separated peak (caused by too large a bubble) are 
less desirable because further sensitivity gains are less than 
proportional and peak broadening will occur. This point is 
approached with a bubble factor of 3 with 50-u.m capillaries 
and bubble factors of 4 to 0 with small capillaries, using the 
iUuminatiori described. 

In practice, demagnifying the source directly onto the cell 
requires careful and individual alignment. Alternatively, 
overfilled aperluivs al the cell can be employed. Since the 
apertures of the unexpanded and bubble cell capillaries 
could conceivably be made equal in area, the standard cell 
and the bubble cell would seem to have the same noise com- 
ponent. Thus the bubble cell would have only the signal 
boosting advantage, yielding a sensitivity gain identical 80 
the bubble factor. However, common source lamps are not 
spatially broad enough to image onto and illuminate the full 
length of the analyte plug in the capillary, but rather only a 
few tenths of a millimeter of it. Therefore, in practice, 
bubble cells even in this case offer some noise reduction as 
well as increased signal. The aperturing practice in general 
extracts a slight overall noise penalty by limiting the total 
flux reaching I he detector to only those nearly parallel rays 
thai actually traverse the cell. 

Reference 1 compares numerous other sensitivity-enhancing 
paradigms, and as of 1903 cites 42 other references in this 
burgeoning field. Many of the high-sensitivity detectors it 
cites are compared at sample volumes of HO-uin diameter 
ami 3-nUTI length, a point marked on the nomograph with a 
doU A bubble cell with comparable volume is seen to have a 
bubble factor of approximately four and yield a sensitivity 



enhancement of lox. Further improvements are possible 
with cells oval or hourglass-shaped in cross section. 

Hubble cells are amenable to use with rectangular capil- 
laries. 2 •'• 4 fluorescence detection. laser excitation, and spec- 
trographie detection. Reference 5 explores the flow charac- 
teristics of bubble cells. 

The bubble cell has been characterized here in one of its 
best configurations, whereas in practice the realized gains 
depend on the individual optical configuration. For exam- 
ple, the HP GlIiOOA CE instrument adds several important 
capabilities: spect rographic detection, interchangeabiiity 
between bubble and conventional detector cells, and aper- 
tured self-aligning drop-in cassettes (see article, page 20). 
HP conservatively represents the cell sensitivity enhance- 
ment as being equal to the bubble factor ( for example, a 3x 
bubble increases the sensitivity threefold). Currently HP 
offers 25-um capillaries with ox cells. 50-um capillaries with 
3x cells, and 75-|im capillaries with 3x cells. 

The bubble cell affords an easy and economical method to 
increase the sensitivity of ("E. It also increases the linearity 
and dynamic range of CE. bringing it up to the quantification 
accuracy enjoyed by liquid chromatography users. Marginal 
sensitivity and poor linearity are no longer barriers to adopt- 
ing CE as a powerful new analysis paradigm. 

Decision lo Automate 

HP's original plan was to employ skilled operators to fabri- 
cate bubble cell capillaries on manually operated glass tallies 
of the kind described above. However, the control of dimen- 
sional tolerances for diverse bubble sizes, blown in capil- 
laries of different diameters, was recognized as a substantial 
challenge, especially as production demand increased. 

Fortunately, the original work took place in IIP Laboratories, 
HP's central research facility. The climate of HP Laboratories 
encourages crossfunctional awareness of the diverse techni- 
cal programs. Asa consequence, the prospects of automat- 
ing the bubble-blowing operation stimulated the interest of 
the manufacturing research assembly technology team 
(ATT). The ATT is chartered lo explore and create flexible 
state-of-the-art assembly technology to solve critical, techni- 
cally challenging, manufacturing problems. 
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Ail extended partnership was quickly formed, involving the 
AST, the Analytical/Medical Laboratory, which pioneered the 
bubble cell detector, and Ill's Waldbronn Analytical Divi- 
sion, which had product design and manufacturing responsi- 
bility. 

Drawing heavily on previously created tec hnology, the ATI' 
carried the project from Inception to manufacturing produc- 
tion in six months, with the investment of one engineer-year 
(if effort. The remainder of this section describes [nibble- 
World, the technical solution, awl in particular the crucial 
role played by computer vision. 

As a starting point, given the proven capability of the manual 

lathe, the ATI" determined to leverage its basic configuration. 
The ATT has many years of application experience employing 
computer vision as a prime sensory modality for feedback 
control of robotic assembly systems. It Was, therefore, natu- 
ral to choose computer vision as the vehicle for real-time 
process monitoring and control and for postfabrication 
inspection and dimensional characterization. 

Specifications and Goals 

Specifications and goals were established as follows: 
Capillary initial inside diameter: 2ii to 75 um 
Customizable bubbles: Variable bubble sizes and 

shapes 

Programmable axial 
stretch 

I'olyimide coaling stripping: Flame removal 



Bubble factor: 1 x to 5 x 

Postinflation axial stretch: 0 to 100 um 

Reproducibility: ±5 um on the inflated 

inside diameter 
Throughput: 2 units/minute 

I lands-off operation, except for loading and unloading 

Automatic quantitative process characterization and logging. 
BubbleWorld Hardware 

A close-up view of the business section of the microlathe in 
operation is shown on the cover of this issue, while Fig. 6 
illustrates an overall engineering drawing. All of the lathe 
operations with the exception of capillary loading are under 
autonomous computer control. 

The lathe consists of a fixed headstock and an axially posi- 
tionable tailstock. The lailstock rides on a preloaded cross- 
roller assembly, and is positioned by one of four dc servo 
motors through a cam-link arrangement. This configuration 
facilitates adjustment to achieve a variety of positional reso- 
lutions and ranges, in addition to providing the requisite 
time response. Similar mechanisms are used to position the 
radial awl axial stages for the torch. A fourth motor drives 
the spindle. 

Identical head and tail spindles are driven by geared belts off 
a common jack shaft coupled directly to the spindle motor. 
The capillary is held concentrically in the spindles by two 
identical collets. Each collet has four fingers formed inte- 
grally with the spindle shaft. Collet design was complicated 
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Fig. o. Sri ii ;i Mi i< drawing ofthfl 
tablctop-size custom microglass 
lathe, nicknamed Bubble World, 
which incorporates foursi-rvoed 
axes and machine vision. 
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by the requirement for clearance to accommodate a stop- 
bead premounted on the capillary' to reference the axial posi- 
tion of the bubble when installing the capillary in the C'E. 
The slop-bead is located close to the bubble, just 4 mm from 
the collet finger tips, posing a headstock design challenge. 

Each collet is actuated to capture the capillary by ;in miter 
cap that screws onto the spindle, imparting a radial closing 
action, A set of locking cylinders set into the stocks actuates 
to engage the outer cap to inhibit rotation. Proper sequenc- 
ing of the lock cy linder actuators relative to spindle rotation 
enables automatic capture and release of the capillary 

Capillaries are inserted through the headstock into the tail- 
stock. Insertion is arrested by the preniounted reference 
stop-bead ( (lining to rest against a registration lip in the 
headstock collet. The capillary is pressurized through a 
pressure cap in the headstock, 15 centimeters from where 
the bubble is to be blown. Since the capillary is one meter 
long and its flow impedance Ls large compared to that of the 
pressure deliver; system, the opposite end of the capillary is 
left open lo the atmosphere. 

Coaxial alignment of the headstock and tailstock axes is 
critical to the fabrication of straight capillaries. Alignment is 
augmented by a small V-grooved linger configuration 
mounted between the collets. The lingers provide added 
support to the capillary during bubble blowing. 

A miniature hydrogen torch is used, first to burn the poly- 
imide coating before the bubble is blown, and then to heat 
the capillary during I lie blowing operation. The torch is 
mounted on a two-axis stage driv en by serv o motors and 
linkage arrangements similar to that used for the tailstock. 
Because the torch temperature is fixed during operation, the 
rale of thermal transfer to the capillary is controlled by a 
programmable radial positioning of the lorch. 

Proper distribution of heat along the capillary is achieved 
through programmable velocity control of the axial stage of 
the torch. This is generally achieved by a dithering motion of 
controllable amplitude and frequency. The vertical height of 
the torch is adjustable! but fixed. 

A CCD camera fitted with a microscope objective views the 
capillary from above. High-contrast images of t he inner diam- 
eter of the capillary are critical for measuring and tracking 
the bubble growth (luring blowing. A single diffused LED 
positioned behind the capillary provides high contrast images 
of the inner and outer diameters. An infrared filler suppresses 
luminous glow from the hydrogen flame and healed capillary. 

The workcell controller is an HP Series 9000 Model 72(1 
computer. It runs the HP- 1 X operating system and the XI 1 
W indow System, and performs all of the data processing, 
including real-lime processing of the bubble images. The 
computer is equipped with a RasterOps VideoLive EISA- 
based IA ) card used as an image frame grabber for the Cohu 
C( I) camera, and to provide live image observation Of the 
bubble-blowing operaiion. All motion control is achieved by 
a Galil four-axis motion controller commanded bv the work- 
station through a serial line. All system sensors and acluaiors 
are accessed via the Galil controller as well. 



Operation 

Bubbles of customizable shape and size can be blown. The 
process development engineer can create and store numer- 
ous bubble-blowing recipes, each containing approxi- 
mately 30 programmable parameters. Parameters define 
bubble profile, torch dithering, spin rates, image parame- 
ters, and the like. The lathe operator need only select a 
recipe. 

Capillary loading is semiautomatic. The operator inserts the 
capillary into the open end of the headstock spindle i right 
side of Fig. li) until the stop-bead is arrested by the registra- 
tion hp inside the collet. The operator genil> holds the capil- 
lary against the lip. while the machine locks the headstock 
cap and torques the spindle to tighten the collet. The tail- 
stock collet is then similarly tightened ( 'nee both collets are 
clamped, the supporting fingers are actuated, the synchro- 
nized collets are set into rotation, and the capillary is 
pressurized. 

The capillaries are manufactured with a thin layer of pro- 
tective polyimidc. This coating is removed from the bubble 
section before blowing. This is accomplished by an axially 
dithered burn-off torching of the capillary. Following bum- 
off, the capillary is imaged to find the inside diameter. 
( Image processing is explained below. ) The torch again ap- 
proaches the pressurized capillary to heat it, and expansion 
commences. During expansion, the bubble image is tracked 
at approximately 10 frames per second. The output of the 
tracking operation is processed lo support feedback control 
of the inflation. 

If the lorch were held at a fixed position during blowing, 
wall thinning at Constant gas pressure would soon precipi- 
tate uncontrolled bubble growth. This would stress the abil- 
ity of the system to control I he final bubble size. Instead, in 
BubbleWorld, w hen the bubble achieves .SO percent of the 
goal, bubble growth is slowed by partially withdrawing the 
lorch. allowing a controlled approach to the final diameter. 

As an optional final forming option lo allow additional control 
over the shape, the bubble can be axially stretched under 
program control by displacing the tailstock Follow ing bubble 
fabrication, its shape is thoroughly and accurately character- 
ized. Lastly the capillary is removed by reversing the loading 
Sequence. The entire cycle takes about 20 seconds. 

Graphical Cser Interface 

Control of the workcell is achieved via a graphical user 
interface (GUI) built upon a generit "id developed at IIP 
Laboratories for robotic workcell control.'' The BubbleWorld 
GUI consists of a set of.Xll windows, each dedicated to a 
particular task. The operator, the manufacturing engineer, 
and the maintenance engineer each access different GUIS. A 
representative set of (il l windows is shown in Fig. 7. 

The lop-level operator's interface consists or three w indows: 
\ision. statistics, and control. The vision window allows I he 
operator to monitor the blowing operation, and includes 
graphical overlays representing vision system Hacking of 
bubble growth. The statistics window reports bubble-blowing 
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performance history. The control window presents the oper- 
ator with a lisi of predefined process recipes from which to 

choose. 

At a second, password-protected, and more powerful level of 
control, production engineers can interact with the system 
to develop processes. This engineer's interface has several 
windows that allow control of the hardware. It includes a 
joystick window which allows independent control of each 
of the axes of I he lathe and the torch XV stage. The engineer 
can control position, speed, and acceleration and the execu- 
tion of hiihble-hlowing suhiasks such as reselling the work- 
cell, chucking and unchucking the capillary, and hunting lite 
polyiniide coaling. An output w indow allows the mining on 
and off of digital output bits and the setting of analog output 
Charmed values. An input window porlrays Ihe stales of sev- 
eral digital inpQl hits and analog channels. A communications 
window shows lite commands sent to the (ialtl controller and 
can he used to send debug commands. A database window 
allows Ihe engineer to store all pertinenl parameters for a 
given recipe, including hardware parameters, and software 
parameters controlling the vision algorithms I hat H ack and 
measure bubble growth A vision window accesses vision 
tracking and measuring parameters. Collectively, these vari- 
ous windows allow easy anil intuitive interaction With Ihe 
w orkcell. along with appropriate levels of security. 

Computer vision 

As previously noted, computer imaging is used for feedback 
control of the bubble-blowing process and for postprocessing 
characterization of each bubble. The bubble image is fed 
from the microscope camera to an image frame grabber 
board which buffers Ihe image for subsequent processing by 
the workstation. All image processing is performed by image 



processing software running on Ihe workslalion. We now 
describe the tluee vision operations FIND. TRACK, and MEASURE 

The FIND Operation. The purpose of FIND is to construct a 
matched niter to be used in the subsequent TRACK operation 
w hich monitors the evolving profile of Ihe inner wall of Ihe 
capillary as the bubble is blown. Fig. 8a shows an image of 
Ihe backlit capillary after the polyiniide has been burned 

away, 

The first step in the FIND operation is to high-pass filler the 
"image of the bunied-off capillar,'. This step highlights ( l oss 
sectional dark-lo light transitions, as illustrated in Pig. 8b. 
Local maxima are referenced to a database of edge-pattern 
Sequencing and diametral information. The result is Ihe 
identification of Ihe capillary walls in the image, as indi- 
cated in Pig. He. 

From the high-pass filter data, a wall-tracking-lilter matched 
to the dimensions of the particular capillary is automatically 
Constructed. The FIND operation is designed to tolerate a 
degree of spatial noise such as that evident in Fig. 8, as well 
as noise caused by an exceptionally dusty imaging array. 

The TRACK Operation. The TRACK operation tracks the growth 
of the inner wall of the capillary. The output of litis opera- 
lion is fed back to conlrol the precision blow ing of custom- 
ized bubbles. To support real-time feedback conlrol of 
bubble-blow ing, il is desirable to process bubble images at a 
rate of at least 10 frames per second. The general-purpose 
computer is not able to apply TRACK over the entire image at 
this rate, but neither is litis necessary; it suffices to process 
only a half dozen transverse sec-lions. 

The TRACK sequence consists of Ihe following steps. First, 
the matched filler derived in the FIND operation is used to 




Fig. 7. A CUStom graphical user 
Interface, (Gl'l) was designed to 
allow the user to develop, exe- 
cute, and monitor the rnanufne- 
luring process easily. Tin-re are 

windows for selling up parame- 
ters, collecting statistics, and dis- 
playing live video of the tomiiug 
Imhhli' 
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Fig. 8. Macliiiie vision and tracking software are key to automating bubble cell manufacture (a ) The UNO rtfp builds a matched filter to 
lornte the inside diameter of a frrsh capillary, (b) A hjgh-|>ass filter pnwesses a cross section of the capillary image to enhance Its edges 
(<•) Peak detection is used to pinpoint the exact inside diameter 



locate the center of the capillary "ii both sides of the re- 
gion where the bubble is lo be blown. Tile central axis of 
the capillary is then defined by a line connecting these two 
cenlerpoinls. 

The image is then analy zed at several equally spaced trans- 
verse segments along the axis of the capillary'- At each of 
these segments, edge and peak detection operations similar 
to those applied in the FIND operation are performed- The 
peaks associated with Ihe first dark-to-Iiglil Iransilion above 
and below the central axis define Ihe diameter of ihe inner 
wall of the capillary. 

In the first few frames, while Ihe capillary is healing up. [here 
will be lit t It- expansion. When the grealesl inner diameter 
among Ihe tracked sections achieves a dalahase-specified 
expansion (typically 121)% of Ihe original diameter), ihe maxi- 
mum diameter is established by parabolically interpolating 




Fig. 9. Tin- track algorithm is used Co monitor the capillary Inside 
diameter growth at several axial segment* along 1 1 «< • fanning bubble 
(i in- wen vert leal lines), inner edges within each segmenl of the 
capflhuy are tracked In real time The three largest measurements 
are fitted wiiii a parabola, the maximum value of which is taken to 
be the bubble diameter I fell Inflation la progressively arrested as the 

bubble expands 



through the three cuts corresponding to the largest trans- 
verse sections. In subsequent frames, all cuts are equally 
spaced between the half-maximum expansion points, as 
shown in Fig. !>. 

If. during the TRACK operation, the program establishes that 
the processed output of any given frame is too noisy. Which 
can be caused by glowing dust particles, polyimide remnants, 
and the like, then thai frame is rejected. 

The MEASURE Operation. The las) operation, MEASURE, applies 
the diameter-measuring algorithms described for TRACK, 
above, loa dense family of sections of Ihe cooled bubble, 
for the purposes of characterizing t he bubble and monitoring 
the performance of ihe lathe. Derived information includes 
the maximum diameter of the bubble and its axial position, 
and the axial positions of the 90% and 10"" expansion sec- 
tions as illustrated in Fig. in. 




Fig. it). KIter blowing Is complete Hum Is less i ritli .it arid a more 
complete liianieteri/.aiion ran lie made The MtAsunr operation de 

leniiines the cell dl: ter. length, and axial position in an accuracy 

of 2%. 
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Conclusion 

The geometry of the bubble cell raises capillary electrophore- 
sis to dramatically higher levels of sensitivity and linearity 
vviihout sacrificing resolution. Application of automation 
and computer vision to the manufacturing process enables 
efficient fabrication of consistent, high-quality, customiz- 
able, documented bubble cells. Over 40, 000 bubble cells 
have been produced to date. 
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HP Disk Array: Mass Storage Fault 
Tolerance for PC Servers 



In the process of offering a new technology to the marketplace the 
expertise of the user is often not considered The HP Disk Array offers 
RAID technology with special installation and configuration features 
tailored for ease of use. 



by Tom A. Skeie and Michael R. Rusnack 



The rapid proliferation of PC-based local area network sys- 
tems and the growing dependence on them has resulted in 
concern about the reliability of such syslems. particularly in 
ihe area of data storage. PC-based systems do not have the 
history or perception of reliability that minicomputer or 
mainframe systems have built up over the years. Thus, it is 
no Surprise that concent about fault tolerance is becoming a 
critical issue in the P( ' community. This concern has led to a 
great deal of interest ;ukI research into external storage sys- 
tems anil redundancy. 

The .significant improvement in CPl." performance in the 
1980s (50 to 100% per year) created the need for similar per- 
formance improvements in other system components, such 
as memory and system storage. Improvements in memory 
performance c ame mostly from new memory architectures 
and algorithms rather than in the memory components. Sim- 
ilarly, magnetic hard disk technology, the most commonly 
used component for system storage, could not provide the 
needed performance improvements. A technology called 
RAID (Redundant Array of Inexpensive Disks) 1 was pro- 
posed as a method for improving the I/< > throughput for sys- 
tem storage. The basic proposal suggested that the I/O 
bandwidth could be improved by spreading Ihe data over 
multiple hald disks to obtain some level or concurrency. 
However, because of Ihe unacceptable trade-off in system 
storage reliability caused by Ibis data distributions multiple 
data-redundancy algorithms ( RAID levels) were proposed. 
A brief tutorial on RAID technology is given on page 71. 

The benefits of improved l/< I throughput and data protection 
have made RAID technology widely accepted on computet 
platforms of all kinds, including I'C servers. While many 
architectures can efficiently implement a RAID storage sys- 
tem, the generic architecture includes the mechanism for 
Implementing one or more of the RAID algorithms t typically 
a hard disk controller) and a method for communicating and 
controlling a group of hard disks (see Fig. I ). 

'I'he IIP Disk Array implements RAID using a hardware- 
based KISA-to-SCSl controller in which multiple RAID algo- 
rithms are Implemented in the controller's firmw are. A con- 
troller implementing RAID is commonly referred to as a disk 
array controller. For Ihe IIP I lisk Array controller five hard 
disks are connected to each of the controller's two S< SI 
buses giving a total ol'KC bytes [assuming RAID level ">) of 
protected capacity controlled by each controller, Pig. 2 



shows the hardware components of the HP Disk Array. 
In addition to the benefits of RAID, the IIP Disk Array Offers 
a wide range of features, such as predictable failure notifica- 
tion, automatic disk-failure detection, and automatic disk- 
failure recovery. What really dilferentiates the HP Disk 
Array from a majority of similar RAID products is the focus 
on making ihe complex RAID technology readily available to 
PC network administrators who may not have an in-depth 
knowledge about RAID technology, SCSI technology, or the 
target operating system. 

After an investigation of other systems offering RAID tech- 
nology, we found that il was difficult to install and config- 
ure many of them properly and to recover from a disk fail- 
ure, even for knowledgeable PC network administrators. We 
saw this as an opportunity to differentiate the HP I >isk Array 
product from other disk array products. New ease-of-use 
software utilities were designed specifically to simplify the 
usability Of the IIP Disk Array product. 

The final product includes several complementary ease ol 
use features such as: 

• A disk array controller optimized lor performance with 
the selected disks 

■ I lard disks prejumpered, configured, and mounted in hot- 
plug enclosures 

• A disk cabinet w ith automatic SCSI ID selection 

' Hoi olug m this context is the ability to replace a MM while the jystem i in operation 
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• Software designed specifically for easy configuration 
and integration of the RAID system into any network oper- 
ating system. 

This article describes the decisions made during the design 
phase- of the HP Disk Array that resulted in making the RAID 
technology significantly more usalile for the typical user 
without Sacrificing valuable product features.. 

Storage Categories 

In a typical computer there are many places lo store infor- 
mal ion either temporarily or permanently- Some of these 
storage media include RAM, shadow RAM (Bit >S). video 
RAM. read cache, write cache, hard disks, flexible disk, and 
tape. Whatever the storage medium, computer storage can 
generally be classified as either primary storage or second- 
ary storage. 



Fig. 2 Tho eompononts of an HP 
Storage system. The SCSI-D con- 
troller, the disk array controller, 
and the Misk miwlule make up the 
HI' Dish Array. 

Primary storage is often referred to as the system memory, 
or just the memory. The memory is typically made from 
Semiconductor components and is characterized as being 
very fast, volatile, and expensive. Computers use memory 
for immediate and temporary storage. This is the storage 
containing the data that the ( PI ' operates on and manipu- 
lates. Most serv ers today typically have about 16H bytes to 
64M bytes of primary storage. 

Secondary storage is often referred to as the system storage, 
or just the storage. The storage medium is most often mag- 
netic and is slower, nonvolatile, and much cheaper than 
memory. The storage is therefore used as a permanent re- 
pository of information. Servers typically have between 
I Gbyte and 100 Chyles of storage. 



Application 

(e.g.. Word Processor) 



1. Operating System 
Request: Read file 




4. Operating System Request Completed: 
File is in memory ready lor application to 
operate on it. 



3. Return Completed I/O Request 

2 I/O Request to Storage Subsystem 2: 
Read file request is translated into storage 
subsystem-specific commands. 



Fig. 3. a typical Vi » request Bow. 
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The relationship beta t en thee two types of storage is based 
on how information is transferred in a typical application. 

The I/O Process 

When an application such as a word processor wants to 
open a file, it ts usuall.v the o|>erariiiR system that is respcm- 
sible for completing dial request . Depending on wheie the 
file is currently located (it could already be in memory ), 'he 
opiT.iting system may generate one or more I/O requests to 
the storage system to bring the file into memory. This pro- 
cess is illustrated in Fig. 3. 

A couple of issues should be poinled out here. First, die Sp- 
plication does not know how or where the operating system 
has stored the file it is requesting. Similarly, the operating 
system may noi know how or where the storage subsystem 
has stored the data making up the file. 

For instance, in a RAH) system one L'( > request from the 
operating system may result in multiple transfers in the stor- 
age subsystem. Since RAID 1 (see page 7-1 ) mirrors or dupli- 
cates all information from one hard disk lo another, e\er> 
lime the operating system requests a file to be written, the 
RAID subsystem must write this file I wire. If the RAID sub- 
system is using RAID ■">, writing a file may result in multiple 
reads and writes. 

Since several I/O transfers may result from a single request 
from the Operating system, something in the system must 
have the intelligence to distribute the data properly and 
know how the data should he retrieved. Obviously, in a mod- 
ular system such as the one described above many ap 
proaches to implementing this intelligence in a RAID Stor- 
age system can be imagined. The following section explores 

the most common raid storage system approaches and 
some of the advantages and disadvantages "I the different 
approaches, 



Several operating systems now offer some method of data 
redundancy bv implementing the RAID algorithms as part of 
the operating system (see Fig. 4a). The advantage of this 
approach is that there is no additional cost to the user. How - 
ever, the |>erformance may l>e affected in fPI'-intensiw 
application server environments such as database engines. 

Not every RAID level is offered through the operating sys- 
tem, and some operating systems offer no data redundancy 
scheme ai all. This hits prompted some storage system ven- 
dors to provide custom software that implements the de- 
sired RAID scheme. Fig. 4b shows the software architecture 
in which the the desired RAID level is provided with an in- 
telligent device driv er. 

Hardware RAID Architectures. In environments where the 
serv er is used for I "IT -intensive applications, adding the 
ov erhead of executing RAID algorithms may significantly 
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RAID Architectures 

A wide variety of architectures have been explored in the 
effort lo provide better I/O throughput and data protection 

based on RAID technology, These architectures can be di- 
vided iulo two major categories based on whether the RAID 

algorithms are executed in the host CPU or a dedicated 

CPU. When using ihe hosl < .'PI . the architecture is gener- 
ally thought of as a soli ware solution, and when a dedicated 
cpi ' is used, the sola! nm is saiil lo have a hardware archi- 
tecture. The major difference between these architectures 
most often amounts to a tradeoff between cost and perfor- 
mance) 

Software RAID Architectures. Since a software RAID architec- 
ture uses the host system CPU to execute, one ob\ ions dis- 
advantage wiih this approach is the potential for lower over- 
all system performance than wilh a dedicated I 'IM ;is in Ihe 
hardware RAID architecture. However, in many environ- 
ments, the host CPU is not used to its full capability There- 
fore, using the server CPI' to execute RAID algorithms pro- 
vides the most cost-effective RAID architecture white still 
providing adequate system performance 
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All Overview of Raid Technology 



The Need for Information Storage 

The trend today is to put increasingly larger amounts of an organization's informa- 
tion onto some sort of electronic media far quicker, concurrent, and geographically 
independent access The information being put on the electronic media is often 
critical to the operation of the organization. This trend has created an increasing 
demand for newer and better methods of electronic storage One such electronic 
storage method is data protection via RAID (redundant array of inexpensive disks) 
technology 

RAID technology finds its roots In a series of papeis referred to as the Berkeley 
papers 1 Although these papers do not precisely define RAID, they do provide the 
basis for the architecture of the technology The need for disk drive redundancv 
developed as the need for data integrity and system reliability became a growing 
issue For example, the consequence of a single point of failure in a disk storage 
system could result in the failure of the enure computer system This loss of pro- 
ductivity and often data was deemed unacceptable 

Seven RAID levels are defined Each level specifies a different disk array configu- 
ration and data protection method, and each provides a different level of reliability 
and performance Since only a few of these configurations are practical for most 
online transaction processing systems, file servers, and workstations, RAID levels 
0, 1. 3. 5, and 6 are desciibed here. 

RAID 0 

Although it is often debated that since RAID 0 is not redundant and should there- 
fore not be considered as a RAID mode, nearly all RAID solutions include this 
mode RAID 0 distributes the data acioss all Hie disks in the disk array configura- 
tion (see Fig, 1 ) Since there is no redundancy, the capacity utilization is 100 percent 
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Fig. 1. RAID 0 configuration 

The data blocks in Fig. 1 are broken into three parts and striped across three disks 
What this means is that while data is being retrieved on disk I , the daia on disks 2 and 
3 can be requested and ready to transfer sooner than if three I/O requests ware made 

RAID 1 

To answer the need for reliability and data integrity, system managers have often 
implemented a solution in which write data is mirrored on two separate disk 
systems. This implementation is referred to as RAID 1 The primary advantage of 
RAID 1 is its simplicity RAID 1 provides a slight improvement in read performance 
over the other implementations Howevei, write performance is poor because all 
data is duplicated. The primary disadvantage of RAID 1 is cost, because for every 
byte of storage used on a system an equal amount of storage must be provided as 
a mirror This results in a cost differential of 1 00% over standard nonreduridant 
mass storage 

In Fig. 2. the data is mirrored on each disk. In the event of a failure on disk 1, the 
same data is available on disk 2 
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fig. 2. RAID 1 configuration 
RAID 3 

The architecture for RAID 3 is often referred to as a parallel array because of the 
parallel method that the array controller uses m reading and writing to the disk 



drives For RAID 3 il is necessary to provide two or more data disks plus an ECC 
(error correcting code) disk Data is dispersed or striped acioss the data disks, with 
the ECC disk containing an exclusive-OH ol the data from the other disks Unlike 
the other RAID solutions, the data is dispersed across the disk in a byte interleave 
rather than the typical block interleave With the spindles all synchronized, the 
data is placed on the same cylinder, head, and sector at the same time In the 
case of RAID 3. each drive is connected to a dedicated SCSI channel which fur- 
ther Bnsures the performance. 

This architecture can handle any single disk failure in the chain If a data drive 
fails, data can be recovered from the failed dtive by reconstructing the exclu- 
sive-OR of the remaining drives and the ECC drive. The advantage of this scheme 
is that redundancy is achieved at a lower cost (compared to RAID 1 ) The pri- 
mary disadvantage is its 1/0 performance for small amounts of data When an 
application requires the transfer of large sequential files, such as graphic images 
for workstations, this is the best method 

Fig 3 shows the configuration for RAID 3 The data is striped across drives like the 
RAID 0 configuration. If a failure occurs, the data is reconstructed based on the 
parity data on disk 3 
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fig. 3. RAID 3 configuration 



RAID 5 

RAID b was defined in an effort to improve the write performance of RAID 1 and 
RAID 3 systems Like RAID 3, the data blocks ate distributed over the disk drives in 
Ihe system, but unlike RAID 3, the ECC data is also distributed across all the drives 
(see Fig 4| With this configuration reads and writes can be performed in parallel 

Disk 1 Disk 2 Disk 3 




= Parity Data 

Fig. 4 RAIO 5 configuration 
RAID 6 

Like RAID 0, RAID 6 is not yet accepted as a standard RAID configuration This 
configuration not only mirrors data (like RAID 1 ) but also stripes the information 
(see Fig 51 Because the data is striped, the performance is very similar to that 
measured in a RAID 0 configuration. The penalty fot use of this configuration is 
that 100 percent more disk space is required 
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fig. 5. RAID 6 configuration 
Reference 

1 D Patterson. G. Gihson. and R Katz. "A Case lor Redundant Arrays ut Inexpensive Disks 
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lower the overall system performance. A separate CPU ded- 
icated to executing the RAID algorithms is therefore used in 
a hardware RAID architecture to offload RAID algorithm 
execution from the server CPU. Since this architecture re- 
quires additional hardware, the major disadvantage here is a 
higher cost than a softw are architecture. 

The hardware RAID approaches can be categorized as inter- 
nal or external solutions, referring to whether the RAID 
hardware resides inside or outside the host server. Internal 
RAID hardware has to interface directly with a host system 
bus. such as with an EISA or PCI bus. Disk drives are then 
connected to the internal RAID hardware directly \ia one or 
more SCSI buses (see Fig. 5a). While such a solution may 
offer superior performance, it does have some subtle disad- 
vantages. Since the RAID hardware must interface directly 
With the host server hardware and operating system, there is 
a high level of dependence between the host and the 
RAID hardware. This dependence affects many aspects of 
the product "s usability, such as the serviceability of failed 
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RAID Provided by a 
Hardware Controller 
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Dovice Driver 
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Fig. 5. Hardware approaches to implementing Che RAID tech- 
nology, (a) Inside the host system ( 1 > > Bxteniiil tn the Must 
system. 



hardware. For instance, if a problem occurs in the RAID 
hardware, the entire server must be shut down for repair. 

This is not the case with an external RMD hardware solu- 
tion. Here the RAID hardware is typically residing in the 
same enclosure as the hard disks, external to the host sys- 
tem (see Fig. 5b) and therefore provides more independence 
from the host system. In addition to making an external 
product more serviceable, the independence allows the 
RAID system manufacturer to more readily support new 
host hardware systems and new operating systems. Since 
the external RAID systems require additional hardware, they 
tend to be more costly and have lower performance than 
internal solutions, 

Many other architectur.il differences exist in RAID systems 
that affect the price/performance ratio. For instance, the 
RAID hardware may use onboard RAM for caching data. 
Such caching can provide a significant performance 
improvement, especially when executing RAID level B write 
operations. For a sequential write operation. RAID hardware 
can calculate the ECC for the stripe without having to per- 
form any read operations if the controller has enough mem- 
ory to cache one entire stripe. Recall that the amount of 
data in a stripe depends on two things: the chunk size and 
the stripe set size. For example, if the chunk size is 64K 
bytes and there are four disks in the stripe set. the required 
• ■ache for one stripe would be 4 > t ">4 K by tes = 25(iK bytes. 
For the PC server environment. RAID hardware commonly 
uses between 4.M bytes and f>4M bytes of onboard RAM 
shared between read and write operations. Thus, cache 
can become a significant cost increase to the overall RAID 
system. 

Architectural differences such as the number and type 
of disk interfaces used (e.g.. fast SCSI, fiber, and SSA (Se- 
rial Storage Architecture)) can also affect the attributes 61 8 
RAID hardware product. For RAID systems that manage 
large amounts of storage, multiple disk interface buses may 
be necessary to obtain the best bus utilization. The CPU 
capabilities will also affect the RAID system price and per- 
formance. 

The IIP Disk Array Architecture 

The HP Disk Array product was intended to take advantage 
of the emerging disk array market for PC servers. It was to 
be Offered as an integrated storage solution for Ill's net- 
work server product. IIP NctServer. as well as a third-party 
storage product. As discussed briefly above, there are many 
viable RAID system architectures and features with different 
end product qualities. Deciding on which architecture and 
features would best fit the IIP Disk Array product was based 

on the following product requirements: 

• Time to market. Because of the dynamics in the PC market, 
a product (or project ) rapidly becomes outdated. If a prod- 
uct is not released within a certain period of time (i.e., "win- 
dow of opportunity"!, it can mead the difference between 
product success and failure. As mentioned, the HP Disk 
Array w as also to be integrated as part of a PC server devel' 
oped by a different IIP Division. Therefore, two separate 
programs were dependent mi a timely release. 
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Operating system support. HP has an established eustomer 

base on a Wide range of PC server operating systems. While 
some companies offer new products with limited operating 
system support, the IIP product requirement called lor sup- 
port on all common PC server operating systems. At the 
time of the first release of the product this included I)()S 
(for boot support ). Novell NetWare. IBM < )S/2, SCO I NIX 
Microsoft ' < >S/2. and Banyan VINES. 
Capacity. Baseil on market research that a typical PC 
server had a storage need of 1 Gbyle lo o Ghyte.s. the IIP 
Disk Array was targeted to offer capacities ranging from 
2 (i bytes to 7 G bytes. 

Performance. Several market research studies found 
that improving I/O performance was the main reason to 
purchase a disk array among most PC server users. Perfor- 
mance was therefore an important product requirement 
Ka.se of use. Entry-level products should have ease of use as 
one of their primary attributes. This was not the case with 
many of the RAID systems we examined. Thus, making it 
easy for our customers to use RAID technology was an im- 
portant requirement for the HP Disk Array product. 

While all of these product requirements Contributed lo the 
product's success, most of them can be considered to be 
entry-level requirements. These are the criteria necessary to 
be considered a competitor in this market. 

The following sections describe in more detail some of 
the challenges the R&D team had to deal with to make the 
IIP Disk Array RAID product easy to use. 

Installation of a RAID System 

Since the PC environment is considered open (that is, hard- 
ware and software from one PC manufacturer are expected 
to operate with any other PC manufacturer's hardware and 
software)) products tend lo be very generic when they reach 
the end user. This often makes the installation and configu- 
ration of new hardware and software more troublesome for 
the user. Installing a new RAID system on a new or existing 
server is no exception. In fact, it is generally more difficult 
since the hardware and the RAID system must be config- 
ured. The installation of a RAID system involves three major 
steps: installing and configuring the hardware, configuring 
the RAID system, and then making the added storage capac- 
ity available to the operating system's storage pool by parti- 
tioning and adding a file system. This process can be quite 
intimidating, even for the most advanced user. Since the 
last installation step is the same (at least very similar) for 
any new r storage, the following sections will focus on the 
first two steps. 

Hardware Installation and Configuration 

After unpacking and verifying that all the pans of a disk 
array system are available, the user must fust install and 
configure the hard disks and then proceed to do the same 
for the RAID controller. 

Installing and Configuring the Hard Disks. Most RAID control- 
lets communicate with the hard disks via the SCSI (Small 
t 'omputer System Interface ) interface protocol. SCSI is a 
general-purpose interface protocol that allows multiple de- 
vices such as disks lo communicate in a peer-to-peer fashion 
on a parallel bus interface. Each device is referenced with a 



device number, or SI SI ID. If the device numbers are not 
properly sel up (e.g.. two devices having the same ID ntun- 
ber). the SCSI system will nol work. 

In addition lo setting the SCSI ID. several SCSI interface 
parameters must also be properly set for each device on I he 
SCSI bus. Among these are sellings for synchronous and 
asynchronous data transfer, data parity check, and maxi- 
mum dala transfer speed. The SCSI devices are configured 
by using hardware and software switches. 

Some RAID systems provide the opportunity to load-balance 
the I/O transfers between multiple SCSI buses. For instance, 
if the RAID system has seven hard disks and each disk can 
offer a sustained transfer rale of 3 Mhytes/s. a single SCSI 
8-bit (narrow) bus with a maximum transfer rate of 10 
Mhytes/s could be saturated (7 > :} Mhytes/s = 21 Mhytes/s 
for commands and data and 0.66 x 21 Mbytes/s = 1-1 
Mhytes/s for data assuming a typical ■'£!% St SI command 
overhead). * Thus, the user must know the approximate 
characteristics of the S< SI bus and the disk drives to distrib- 
ute the disk drives properly. 

Before hard disks can be used for storing useful data, they 
have lo be low -level formatted This is a process in which the 
magnetic medium of the disk drive is divided into generic 
fixed-size sectors (typically ">12 bytes) where data can be 
stored. 

Installing and Configuring the RAID Controller. Setting up the 
RAID controller is perhaps the most difficult and definitely 
the most critical part of the hardware installation During 
this process the user has lo power down the server, lake the 
eOVer off the Server PC. and install the RAID controller inlo 
an empty slot. If not handled properly, static electricity 
could cause the entire server to malfunction after this opera- 
tion. Rather, if the controller has hardware .jumpers, they 
must be configured before the eonlroller is installed in the 
server. 

Once the system is put back together again, a configuration 

program, such as the EiSAContig program for an eisa system. 

is run to assign host system resources to the controller (e.g.. 
IRQ and Bit *S addresses). Since the RAID controller has one 
or more SCSI interfaces in addition to EISA, it is very com- 
mon to configure the Controller's SCSI parameters with the 
EISAConfig utility. 

RAID System Configuration 

Once the hardware is Installed and configured, the RAID 
system configuration can begin. To the user this is probably 
the greatest challenge in the entire installation process be- 
cause the RAID technology introduces many new terms and 
concepts such as Stripe sel size, chunk size, and RAID level. 
The user must understand how the selection of a parameter 
will affect the system in terms of dala protection, system 
performance, and capacity utilization. 

Fig. 6 shows the dependency relationships between some of 
the configurable RAID system parameters. Note that Fig. (i is 
not meant as a complete picture, but only as an illustration 
of the complexity involved in determining the values lo as- 
sign to these parameters. The operating system is the only 

I he niojuinum number ot devices on a narrow SCSI bus is eight, and sines the disk controller is 
considered to be one device, a mammum ot seven rtatd disks can be connected to the bus. 
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entity in l-'iii. 6 thai has no dependencies because iis configu- 
ration is typically Bxed by the time the storage system is 
installed. Without a thorough understanding of these depen- 
dencies, the user will no) know whal effect (he value as- 
signed in one paranreter will have on the remaining installa- 
tion. The following sections look at some of these 
parameters anil I heir dependencies in more detail. 
• Snipe sel size. Before any other selections such as logical 
VOlUme size and BAUD level can be Set, ;> decision mUSl he 

made on how the hard disks should be grouped, A snipe set 

is Ihe collection of disks that make up an array that imple- 
ments a RAID level that typically uses a disk Striping tech- 
nique^ Disk striping involves spreading data over multiple 
disks in an interleaved pattern to Improve performance (see 

Fig. 7). Selection of a stripe sel givall.s affects the remaining 

configuration parameters such as the RAID level and logical 
volume size. Th€ behavior of the array will also he af- 
fected, especially in lernis of its performance. Stripe sel 
size has the following dependencies: 

Performance. If the hard disk enclosure has multiple SCSI 
channels with hard disks distributed over multiple chan- 
nels, it may be desirable to have multiple stripe sets to 
obtain belter performance of the overall sysleni. Also, 
depending on the nature of the data and the frequency of 
distribution, multiple stripe sets may be desirable. 
RAID level. Bach RAID level has its own constraints or 

requirements. For example, raid level I can only be used 

with an even number of hard disks, while RAID level 5 can 
be used with an even or odd number of hard disks. 
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Fig. 7. 'i\vn examples or dish striping and different stripe act 

sizes. Data is spread over disks In equal chunks (or blocks) Of 

data. A chunk is typical!) between 4K bytes and 64K bytes. 0j 
using iiii.s scheme of spreading tin- dam among multiple disks, 
controller can overlap operations in the disks and thMeby improve 
ihe overall data access. for example, in in i two chunks (,-,« . Rfi mid 
HI i coUld !«• read in the same nine it lakes I" read one chunk Ifthc 

system baddwldth allows, ii is clear tha) the sn ipe set in (h) win 
have more concurrent data access than the stripe set in (a). 
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urn spate. Depending on the number of hard disks avail- 
able, il may or may 1101 be possible lo have a hot spare 
(standby hard disk) that will automatically replace a failed 
hard disk in the stripe set. Further, unless all logical v ol- 
umes defined in the stripe set are configured to be redun- 
dant (RAID levels 1. 5, or 6), a hot spare will not serve its 
intended purpose in the event of a disk failure. 
RAID level. Choosing the RAID level is one of the central 
parameters in the RAID system installation. Il has a lot of 
inlerdepcndencies. including: 
Data Protection. If the storage system is to withstand a 
disk failure, some redundancy scheme such as RAID 1 or 
") must be selected. If no protection is required, RAID 0 
may be the best choice offering best capacity utilization 
and good performance. 

Performance. Selecting a RAID level will have a signifi- 
cant impact on the I/< ) performance. For instance, if the 
1") request types are random writes. RAID "> is the lowest- 
performance selection one can make and RAID 6 would 
be a better choice. 

RAID volume size. RAID levels 1 and (i will consume -~>( >"•■ 
of the av ailable storage Capacity, while RAID 6 costs one 
ilisk out of the total number of disks in the stripe set. For 
example, if the stripe set consists of five disks, RAID ."> 
will offer four disks or 80% of usable capacity for data 
storage 

RAID volume size. Some RAID systems allow multiple parti- 
tions within one si ripe set. This allows the user to custom- 
ize the storage by having a mix of volume sizes, RAID levels, 
and caching schemes. Some dependencies for the volume 
size include: 

RAID level. As already mentioned, the RAID level dictates 
what remains of usable capacity. 

Operating System. Some operating systems, such as OS/2, 
cannot use partitions larger than SG bytes. Therefore, it 
may be necessaiy to make multiple partitions because of 
such operating system limitations. 



• ( hunk size. Selecting the proper amount of contiguous data 
stored on one disk (chunk size"), is probabl.s the most diffi- 
cult task in configuring a RAID system. It is easy to explain 
what chunk size is, but challenging to explain the implica- 
tions of selecting different chunk sizes. Chunk size mainly 
affects the performance of the storage system, but the diffi- 
culty lies in predicting how the performance will be af- 
fected. The following considerations are important in select- 
ing chunk size: 

Operating system. Based on the I/O request size, the 
chunk size should be set to some multiple of the request 
size. For Novell NetWare, this poses an interesting di- 
lemma because the I/O request size can be selected for 
each volutin' during installation of the file system. Other 
operating systems, such as SCO I NIX. have a fixed I/O 
request size. 

Coin roller cache. Cache use w ill also affect how the 
chunk size should be set. For example, il is often desirable 
to fit full stripes in cache for RAID 5 writes. 
I/O request type. The more sequential the requests, the 
more benefit larger chunk sizes will have. 

The HP Disk Array Configuration and Installation 

It is obvious from the discussion above that configuring a 
RAID system is not a trivial task. This section describes 
some of the features the III' Disk Array provides to make il 
simple for users to install and configure a RAID system. 

To simplify hardware installation of the HP Disk Array. Ihe 
hard disks come preformatted and preconfigiircd from the 
factory. Since IIP is able to control the hard disks used with 
the RAID coin roller, il is possible to optimize all configura- 
ble parameters at the factory'. Any configurable parameter 
that cannot enhance the product but could instead lead to 
less than optimized configurations has been removed. Even 
the SCSI ID selection has been automated By selecting the 

• Chunk sue is also reteiied lo as block sus 
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Fig. 9. A RAID configuration in wltirh a DOS part itimi musl be 

cntittd 

slot in the cabinet, the SCSI II) is also automatically deter- 
mined. For the RAID controller, the configurable parameters 
have been optimized as default settings. The SCSI bus use 
has also been optimized by matching the characteristics of 
the known liisk drives that can be used with the product 
The user does not have to understand any performance or 
configuration aspects of SCSI 

After I he hardware lias been installed, the user must config- 
ure the tlisk array. A bootable flexible disk is provided that 
prompts the user to select the language of choice. The instal- 
lation process will then allow the user to configure the array 

The atTay configuration utility used with the MP Disk Array 
is called JetSet. Some of the features of JetSet utility include: 
Sensing and guiding. JetSet will sense if the array is uncon- 
figured, if new hard disks have been added, or if a recovery 
operation is required. It will then guide the user to perform 
all the necessary steps lo complete the operation 
Limit choices. JetSet will only present options that make 
sense for the current operation. For example, a hot spare 
hard disk does not make sense for a RAID 0 volume, and the 
option should not even be offered to the user. This approach 
also limits clutter on the screen 

Standard defaults. If the user presses the Enter key continu- 
ously through a few option screens, the array will be config- 
ured to the most common defaults. The user has to make 
different Selections to deviate front these defaults. 
( ontexi-sensitivo help. JetSet offers extensive context-sen- 
sitive help throughout all menus. The goal here is not lo 
require the user to consult a manual during the configura- 
tion process. 

Limit new terminology. JetSet is designed to keep the lan- 
guage as simple as possible and not use engineering jargon . 
A new technology typically brings new terminology. How- 
ever, many new terms can often be explained with more 
familiar terras. 

JetSet Coral] operating systems. To further simplify the 
learning curve for the user. JetSet is made available in the 
same form for all supported operating systems. This pro- 
vides the benefits of simplified software control and users 
manual. 

A sample of the main JeiSet configuration screen is shown 
in Fig. 8. The user is only prompted to make decisions rele- 
vant to the configuration process. 

< luce the RAID system has been configured and initialized, it 
Is ready for use by the servers operating system for data 
storage. If the RAID system is the only storage on the server, 
it can be made bootable by creating a D< IS partition and 
assigning a D( »S file system. This is the case for Novell Net- 
Ware as show n in Fig. 9. 

This is an Important point because some RAH ) systems will 
not allow the creation 'if multiple partitions within one 
stripe set. This increases the cost of the system because the 
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Fig. 10. (a) Data layout in a Ft MD n system, lb) Data lav ailei 

adding a now disk. 

user must either assign a separate hard disk apart from the 
RAID system as the boot device, or if the RAID system is the 
only storage system on that server, the D< IS bootable parti- 
tion would be a minimum of a single disk size I I to 1 (ibyt 
and if protected, would take that number times two. The Hi 
Disk Array allows eight volumes for a stripe set using any 
mix of capacity. RAID level, and caching strategy. 

Balancing ease of use and a rich feature set can be very 
challenging because most manufacturers of products such 
as RAID systems want to make the products general enough 
so that they can be used on any host system in any operating 
system environment With the must features of any available 
product (a marketing dream). Such generality also chal- 
lenges the simplicity and ease of use of the system i'lr ffi 
I )isk Array is an example of how few trade-offs wore marie. 

Adding Capacity to a RAID System 

Adding capacity to an existing RAID configuration is a « "1*- 
known dilemma with this technology, since tin- data is 
spread over many disks, a new disk cjuuiot simply be added 
without shuffling the data around In Fig. 10 data is spread 
over three hard disks in an interv al of block size B. Each 
hard disk has u blocks and therefore the array has u snipes. 
To be able lo add capacity to the existing stripe set. some of 
the data shown in Fig. 10a has to be moved onto the addi- 
tional disk such that the block layout ends up looking like 
Fig. Hlb. This example is specific for RAID I). 

Adding capacity becomes more Complex when the system is 
configured as a redundant RAID level. Most RAID systems 
require a complete backup, reconfiguration, and restore for 
a capacity increase. Algorithms ore being developed to allow 
a capacity increase for ail existing stripe set. but are beyond 
the scope of this discussion. 

The III' Disk Array offers a new and simple scheme for add 
mg capacity called emergency capacity, Ratiiei than solving 
the complex problem described above, emergency capacity 
simply adtls a new stripe set lo the RAID system (see Fig. 1 1 ). 

The c aveat here is that the new stripe sei does not have any 
tlisk array characteristics such as added performance and 
data redundancy. In fact, it is simply a JIM )l • (just a hunch of 
disks) Configuration However, it meets the customers need 
of immediate capacity expansion. At a more convenient 
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Fig. 1 1. Adding emergency storage capacity in an 111' Disk Array 
n iiiriguraliun. 

lime, the user ran perform the proper operation for capacity 
expansion. 

Recovering From a Failure 

Another major reason why organizations invest in RAID 
systems is protection against system downtime. According 
to the March 19!)4 issue of Byte Magazine, a survey of 450 
information service executiv es at lntiti major eompanies 
found computer downtime cost an average of l'.S.$7K, l!ll 
per how and occurred, on average, nine times a year. A typi- 
cal outage cost L".S.S30().(K«) including the cost of recovering 
or reconstructing the data. However, failures can and do 
occur, making notification of a failure essential. Some fail- 
tires do not cause any disruption in the I/O processing (per- 
formance may suffer some ). while other failures will bring 
down the entire server. 

Failure Notification. Before any manual restoration process 
can begin the system administrator needs to know that a 
problem has occuned. The failure notification method is 
therefore a very important part of the RAID storage system. 
The notification should be immediate (i.e.. within minutes of 
the failure), visible, and understandable to the administrator. 

Many approaches are used for failure notification. Standards 
such as SNMP (Simple Network Management Protocol) and 




Fig. 12. Failure recovery, (a) KAii l system with a in>t spare before 
die failure no After disk -> has railed and tin- hot spun- is brought 
online, 

DM! (Deskiop Management Interface) are emerging. How- 
ever, since standards have a tendency to take a long time 
before they arc complete enough for the indusliy to use. 
industry tends to take its own direction. 

Failure Recovery. As mentioned, some failures are recover- 
able. One such recoverable failure is a single hard disk that 
is part of a redundant RAID stripe set. The storage system 
may have the ability to recover by itself by rebuilding on a 
hot spare (standby hard disk). The failed disk should lie re- 
placed to make it the new hot spare. If the system does not 
have a hot spare, the failed disk must be replaced before 
rebuilding can lake place. 

Fig. 12a shows the storage configuration before a failure 
and Fig. 12b shows what happens after a failure on disk 2 
and the completion of using the hot spare (disk 4) to rebuild, 
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The HP Disk Array lakes failure notification one step fur- 
ther. In addition to offering notification of failures that have 
already happened, it offers a predictive failure notification 
so that for some failures, the user will be warned about fail- 
ures that are about to happen before the system is degraded. 

It is essential to get notified about failures at some accessi- 
ble place. If the server is not physically close to where the 
system administrator is located, audible alarms and mes- 
sages on the server are not wry useful. The HP Disk Array 
offers an integrated warning mechanism using S.VMP traps 
lo an HP NetServer Assistant/OpenView remote console. 
This allows the system administrator to view error logs and 
failures from any location (see Fig. lo). 

The HP Disk Array offers automatic failure detection and 
restoration of redundancy with the use of a hot spare disk 
drive. If no hot spare is used, the online version of the.IeiSel 
uiilil> is required lo stall the restoration process. I'pon 
loading, the online JctSct utility will notify the user about 
which disk has failed and needs to be replaced before the 
restoration can begin. 

Conclusion 

In developing products based OB emerging technologies, il is 
the responsibility of the designers to make sure that these 
technologies are quickly accepted and available lo the typi- 
cal user. However, in the effort to bring a product lo market 
in a timely manner, the end user is often not prioritized. The 



result Is a product that reflects the complexity of the tech- 
nology it is built on. 

The overall goal for the HP Disk Array design team was to 
provide RAID technology to the average PC network admin- 
istrator. Defining what an average PC network administrator 
mean! and what such a user knew about RAID technology 
took center stage throughout the development. The result- 
ing product is easy enough to use for a novice user, but still 
provides options and information for the more advanced 
user. 
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COBOL SoftBench: An Open 
Integrated CASE Environment 



With the aid of a mouse and a menu-driven interface, COBOL 
programmers new to the UNIX® operating system can improve their 
productivity with a tightly integrated toolset that includes an editor, 
compiler, debugger, profiler, and other software development tools. 

by Cheryl Carinichael 



Many largo companies today are Mill developing mission 
critical ('( >BOL applications, anil the.\ want tools to help 
them easily transition their developers to open systems. 

In 1M!I1, we recognized that many of our customers were 
moving MIS applications to the I "NIX operating system 
using (' Soli Bench and C+ + Soli Bench. These customers 
asked for a more husiness-oriented language— specilically 
COBOL. In addition, HP-UX* had just been recognized as the 
leading L'NLX system environment for MIS organizations 
moving from mainframes to open systems. 

We heard nisi Miner eonrems about moving MIS development 
teams to open systems. They wanted to minimize the loss of 
developer productivity associated with learning a new operat- 
ing system and new development languages and rewriting 
their custom applications. 

TheCOBt )|. SoftBench family is based on IIP MF COBOL. 
Hewlett-Packard's implementation of Micro Focus CI )|!i >L. 
which is based on technology from Micro Focus, Ltd. 
C( )B( )L Soft Bench leverages a deveh >pmenl team's ( '( )B< )L 
expertise and protects its investment in C< )B< »L applications. 

When we were designing C< )BOI. SoftBench we aimed al 
novice I'NIX-system users. These users minimize their 
learning nin es with the aid of a mouse and a menu-driven 
interface, Several tools have easy-to-use graphical user inter- 
faces, and common UNIX commands are accessible via sys- 
tem menus. 

('( )B( >1. SoftBench improves developer productivity with a 
tightly integrated toolset that includes an editor, compiler, 
performance analyzer, debugger/animator, static analyzer, file 
comparator, email, and more. Other items provided by 
C( )BOL Soft Bench to improve productivity include: 
Graphical views of complex programs 
Dozens of integrated third party tools 

Provisions for developers to integrate their own tools using 
the Soli Bench encapsiilator' 

The ability to automate repetitive tasks using the SoftBench 
message connector 2 

Support for mixed-language development with 
C( >B< >L'C SoftBench and C< 1BOIVC - - SoftBench. 



COBOL SoftBench 

Our tightly integrated toolset increases developer produc- 
tivity. The interactions between the Soli Bench programs 
that make up this toolset are shown in Fig. 1. 

• The SoftBench program editor! edits program files, shows 
the column and line location of the cursor, accesses version 
control for a file, and performs common CNIX commands 
on a file. 

• The SoftBench program builderl controls compilation and 
linking Of application files, provides views and, lumps lo 
source code for compilation errors, creates makefiles, and 
displays makefile dependency relationships graphically. The 
program builder also supports embedded ( ICS (Customer 
Information Control System I statements and SQL applica- 
tions. 

• The Soli Bench C( IBOL animator uses an enhanced window 
interface to the Micro Focus ('< IBOL animator to debug 

I See reference 3 tor more information about ihese SoftBench tools 




Fig. i. Interactions between SoftBench tools that make up the 1 1 1 

Bl II. Sufi Bench toolset 
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executable COBOL programs, provide access to nativ e com- 
mands for expert Micro Focus users, display data monitors, 
and allow mixed-language debugging 
1 The Soft Bench static analyzer enhances visual code hrows- 
ing by graphical or textual representation of program struc- 
ture. 

The SoftBench COBOL profiler uses an enhanced window 
interface to the Micro Focus COBOL profiler to supply de- 
tailed statistics about die run-time performance of a COBOL 
program, li determines performance bottlenecks and helps 
the developer make changes for I he greatest improvements. 

Other integrated tools that are not shown in Fig. I include: 
The SoftBench development manager* handles file and 
director).' management and version control. 
Computer-based training comes with each -SoftBench 
product. Each computer-based tutorial tells about individual 
tools and exposes the user to a wide variety of SoftBench 
capabilities using several hands-on training examples. 
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Fig. 3. Seli'cluig several COBOL fill's for culllpllaliuii 



Friendly L'ser Interface 

COBOL SoftBench developers are buffered from the stan- 
dard UNIX command line entry formal. They select bullous, 
toggle options, choose menus, and drag-select texl. Typing is 
left for data entry and editing source code. The following 
model shows how a user would view the I NIX operating 
system through the COBOL SoftBench interface. 

The SoftBench development manager directory list presents a 
list of files in the currently viewed directory and allows vari- 
ous actions to be performed on any file. For example select 
Directory Show Full Listing to view a complete directory listing 
including permissions, owner, group, size, and modification 
lime (sec Fig, 2). The files displayed in the directory list can 
be limited by using predefined or custom fillets. 

Within Hie directory listing, a single line, multiple lilies, or 
even discontiguous lines can be selected for the same ac- 
tion. To select discontiguous files, hold down Hie Ctrl key 
while clicking the left mouse button on each file name. For 
example, to compile scattered source Dies, select the dis- 
contiguous .cbl files show n in Fig. 'I and then choose Actions 

and then one of the compile selections. 
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Fig. 2. A directory listing produced by using the SoftBencii develop 
meni manager^ Directory Show Fuii Listing menu Item, 



Moving about in a directory only requires a mouse movement. 
To change to another directory and view its contents, move 
the mouse focus to the context line. While holding down the 
right mouse button, move through directories until the de- 
sired directory is highlighted. Release the mouse button anil 
a new directory lisl displays. 

Tlie SoftBench development manager helps manage files and 
directories on the developer's computer and across the net- 
work. From the File: menu item, the developer can easily 
choose Edit, Copy, Rename, Import, or Delete depending upon the 
task. 

A number Of commonly used I "NIX Commands are available 

from the System menu. These include: 
i Changing a file's permission 
■ Printing a file w ith a number of printer options 
i ( 'becking the spelling in a Hie 
1 Counting lines, words, and characters in a file 

Creating a backup copy of a file 

I pdating the modification time for a file. 

Supporting Code ll.se Model 

New C( )li( H. Soft Bench users want to leverage their C( >I5< »L 

development expertise and protect their investment in exist- 
ing C< (IK M. applications The following example shows how 
a ('< >B< >l, dev eloper who is maintaining unfamiliar code 
WOllld use < '< 'IK >L Soli Bench to tackle a problem that might 
arise in a ( '( >lt< )l. software maintenance environment. 

In this scenario ihe developer receives a complaint thai Ihe 
inflation calculation program (intcalc.cblj lakes loo long to 
Start To deal with this complaint, the developer must 
quickly identify the performance bottleneck, fix the prob- 
lem, and verily that the fix does indeed improve the applica- 
tions performance. 

Source Code Control. The inflation calculation program has a 
filesei containing mfc.alcsuu.c. infeale cbl, header.cpy, and Make- 
file. The developer sels up a win king directory using Ihe 

SoftBench development manager and checks these files out 
of a revision control system. The revision control systems 
that t '< >i!i KL SoftBench can be configured to use include 

R< IS, SCCS. |'V( S. ClearCa.se. and others. 
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COBOL Profiler - Sort Options 



Fig. 4. The SoftBench program 
sen nips dialog box. 



milder nnd the i !( >l« >L compile 



Compile Options. The application must be compiled to enable 
the generation of performance statistics, I'sing the Soft- 
Bench program builder, t he developer enables the Profile op- 
tion with a mOUSe click ill the COBOL compile settings dia- 
log box and compiles (he application (Fig. I). The COBOL 
SoftBench environment accepts many control options which 
tailor the compile for special needs. 

Micro Focus Run-Time Settings. Over 200 options are available 
in the Micro Focus COBOL development environment. 
COBOL SoftBench provides a way to View and change op- 
lions and values easily. Over 50 of I he mosi common options 
are available from the SoftBench program builder via the 
COBOL compiler sellings and C< )BOL run-lime settings dia- 
log boxes. 

Application Execution. The application is executed to generate 
performance data. When the developer runs the application 
from the SoftBench program builder, the files infcalc.rpt and 
intlcalc.ipf are created. 

Application Performance Analysis. The SoftBench COB( >1. 
profiler makes il easy to determine where the application is 
spending its time. Remember thai for our example, the per- 
formance complaint is about slow startup. The developer 
notices that a large amount of lime is being spent in the ini- 
tialization module (Fig. 5). 
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Fig. <>. The ten options tot sort inn perfoonance statistics, In tins 
example Cfo modules in the program being evaluated will lie sorted 
according to the amount of time spent In each module; 

The SOfl Bench COBOL profiler is an encapsulation of the 
Standard Micro Focus C< )BOL profiler tool. The COM >t- 
SoftBench Implementation enhances the Micro Focus pro- 
filer listings of performance data by displaying the data in a 
SoftBench window. Flexible reporting capabilities are avail- 
able. For example, Ihere are ten ways to son performance 
statistics (see Fig. (i). I'sing the Options: Display Options from 
the profiler window, the developer can also choose to view 
only entered data, nonentered data, or all the paragraphs in 
the program. 



SottBench - COBOL Profiler 
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Program Structure. Tin- Soil Bench sialic analyzer allows I lie 
developer in save lime in searching for program errors hi 
unfamiliar Q )Bt )L code. From the Soi l Bench ( "( )BOI. pro- 
filer, the developer doable clicks on the line in Fig. 5 show- 
ing the initialization module. This action brings up the Soft- 
Bench program editor displaying the source code, starting al 
the beginning of I he selecled module (Fig. 7). 

The developer needs In learn aboul the relationships between 
the many pails thai make up the application without having 
lo read the unfamiliar code. I sing (he mouse button, the 
developer drag-selects 000 -MAIN-MODULE anil chooses the 
Show Definition! I menu item lo bring up I lie Soft Bench sialic 
analyzer. Now, the developer can quickly display the pro- 
gram Structure graphically using the Graph: Query Graph menu 
item (Fig. 8). 

Existing Relationships. The static querj graph shows that the 
inilializalion module performs Ihe 150-ZERO-FIELD paragraph. 
Looking back al the Soil Bench ('< >B< ft profiler in Fig. ">. the 
developer sees that this paragraph is called 1000 limes! 

Within a very short lime, ihe developer knows where the 
program is spending lime, has an understanding of ihe pro 
gram Structure, and is ready lo debug al a specific paragraph. 
In Other words, Ihe developer has a good Marl Inward solv ing 
the problem. 

Program Animation. I'rngraiiiniers frequently need in under 
stand a program's logic. By dynamically watching lines of 

source code execute, they can Identity when the behavior 

of Ihe program differs from whal I hey iniended. 

I 'sing ihe Softl$ench t K >B< >l. animator, the dev eloper selects 
Ihe line of code I hat perforins the paragraph in question, 
PERFORM 150-ZERO-FIELD UNTIL ZERO-COUNTER = 1000 ( Fig. !)). 
Choosing Breakpoints Zoom executes ihe program through Ihe 
step just before the perform statement in question. While ihe 
animator is paused, the developer can view Ihe code lhal is 




Fig. 8. The SoflBench static analyzer and the sialic graph showing 
the structure of the < alculaiion program 

abOUl tO be executed. Looking at this paragraph reveals that 
the WS-ARRAY array elements are being sel to zero. 

Tin 1 developer now selects the Animate builon. The animate 
mode single steps through the program. As each line exe- 
cules. watch windows show Ihe name and value of all vari- 
ables lhal change, The developer finds that the program 
executes this loop 1000 limes, just as il was iniended. 

Textual Static Queries. The Show menu shown in Fig. in 
helps locate any place a specified identifier is referenced. 
Frnin the SoftBench GOBI »1. animator, the developer drag- 
selects the WS-ARRAY identifier and then Chooses Show: Ref- 
erences! I. There are only Iwo references: Ihe declaration 
and Ihe perform Statement 

A more experienced developer could have avoided Ihe ani- 
mator steps by editing Ihe 150-ZERO-FIELD nude from Ihe Static 




Fig. 9. The Soli Bench COIM l|. aniiiiiilnr showing .i Iciir-ofl Break- 
points. Zoom menu B»d two examples of watch windows \ teaivotT 
menu is a group nl menu commands thai have heeii "lorn off - from 
their parent menu. The parent menu in this case is Bieakpoints A 
ii ,n off menu ..lluws the user In keep on the workspace frequently 
used menu items even after ihe parent menu item in no longer se- 
lected, Fig. 'I shows ciuse in which a menu could liecomc u tear-off 
menu By clicking on the dashed line, the menu items shown below 

tin- Actions command would become a tear-oH menu 
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Sections and Paragraphs In ( ) 
Sections In ( ) 



PCflf 0RM«/G0IO» to ( ) 
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Fiji- 10. The Show menu is used to hotp locate whore 'i specified 
identifier is referenced in a program. 

graph and checking llie references lor WS ARRAY from the 
Soil Bench program editor- 
Source Code Modification. This defecl 11 x is a simple one; 
delete the unnecessary perform loop. From the SoftBench 
COBOL animator, i lie developer chooses Ble; EdH and edits 
infcalc.cbl. Then I'niin the Si ill Bench program editor, the 
developer searches for the ZERO-FIELD string, removes Ihe 
unused code, and saves the changes to {he Hie. 

If Ihe developer had needed to make major changes to Ihe 
code, the Soil Bench program builder would lake away the 
pain of folding compile errors. After Ihe developer saves and 
compiles the program, any errors found are displayed in Ihe 
Build Output area, To browse and fix errors, Ihe developer can 
select the First button or select any error in the list, The asso- 
ciated source file appears in Ihe SoftBench program builder, 
wilh Ihe lexl cursor located at the beginning of ihe line 
where the error was detected ( Fig. 11). 

Improved Application Performance. Before the i ode is returned 
to the version control system anil production, it is important 
lo confirm thai a lower percentage of time is spent in Ihe 
initialization module. The developer recompiles the program, 
with Ihe Profile Option still enabled, dins the program again 
and from Ihe Soil Bench C< >B( >L profiler, selects the Entered 
Paragraphs Only display Option. This shows thai Ihe 150-ZERO- 
FIELD paragraph is not entered during the application's exe- 
cution (Fig. 12). 
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Mixed-Language Model 

Ilevelopment teams can take advantage of other technologies 
with ( '( )BOL SoftBench. For example, consider the devel- 
oper who is writing a mixed-language application. One pro- 
gram module is written in COBOL, while another is a sub- 
routine written in C. The COB< >L module calls the C 
subroutine. 

To illustrate the COBOL Soil Bench model, consider Ihe sce- 
nario in which the developer has set up a working directory 
using the Soil Bench development manager and is using ver- 
sion control on Ihe the Iwo source files mixedtestcbl and 
cpart c. The program is not working as the dev eloper ex- 
pects. To help determine whal is wrong wilh Ihe program, 
Ihe SoftBench C* )BOL animal or and Ihe Soil Bench program 
debugger (for Ihe (' subroutine) are used. 

Custom Run-Time System. Wilh a mixed-language application, 
a custom run-time system is pail of the application. From 
Ihe Sofl Bench program builder, Ihe developer creates a 
makefile, which detects mixed source code files. With this 
makefile, COBOL Soil Bench will aulomalically create a cus- 
tom run-lime system. Nexl. Ihe developer sets compile op- 
tions to sel up both programs for debugging and then builds 
the application. 

To verily that the makefile is working as expected, the de- 
veloper brings up I he dependency graph browser ( Fig. 13). 
This graph shows cpart.c is compiled lo an object file and 
mixedtestcbl is compiled lo an intermediate largel. 

Mixed-Language Debugging. Since Ihe ( '< •]!' >I, program is the 
entry point in (his example, Ihe developer stalls from the 
Soil Bench COB( ML animator, and Ihe mixedtestcbl source 
code is displayed ( Fig. 1-1), The developer chooses File: Soft- 
debug Adopt t0 display Ihe Sofl Bench program debugger win- 
dow. After Setting a breakpoint at the C procedure etilry. 
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Fig. li. The SoftBench program bunder showing the toe in the 
program where the error occurred. 



Fig. 13. Dependency graph to verify thai the makefile is correctly 
identifying a mixed-language file 
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Fig. 14. The SoftBench COBOL 

animator Jirid I lie Soft Bench pro- 
gram debugger being ilspiI to de- 
bug a mixed-language program. 



the developer selects the Continue button, which returns the 
control hack to the Soft Bench COBOL animator. 

With both debuggers stalled, the developer is ready to debug 
the application using both the Soft Bench C< >UOL animator 
and the SoftBench program debugger (collectively called 

debuggers). 

Control transfers between the debuggers as the application 
executes the program module or the subroutine The devel- 
oper can applv all the features ol'eilher debugger, such as 
selling breakpoints, watching variables, or selling variable 
values. 

COBOL and C++ Mixed Program. When a custom run-time sys 
ten includes C++, the C+ + language requires thai the entry 
point be the C++ main function. The developer starts the 
SoftBench program debugger and the main.c source code is 
displayed. Choosing File. Animate Adopt displays the SoftBench 
( X >B( IL animator window The program begins execution at 
the entry point displayed in the SoftBench program debug- 
ger window, and again control passes between the debug- 
gers, depending upon the application's behavior. 

Conclusion 

HP's integrated application development toolsets. ( '< )BOL 
SoftBench. G< >B< M SoftBench. and COBGL/C+-t Soft Bench 
help ( ( )B< >L programming teams easily transition to open 
systems. In addition, these products help position the teams 
to transition to new application development technologies. 
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Development and Use of Electronic 
Schematic Capture in the Specification 
and Simulation of a Structured- 
Custom ASIC 

ASIC designers must sometimes provide the ASIC vendor with 
documentation describing the data path of the chip and its relationship to 
the control portion. This paper describes a method and attendant tools 
that facilitate the employment of commonly available electronic schematic 
capture software to ensure that the documentation given to the ASIC 
vendor always matches the Verilog HDL descriptions used by the ASIC 
designers for simulation. 

by David A. Burgoon 



This paper briefly recounts (lie development and use of 
schematic capture in the design of a structured-custom 
ASlc (application-specific integrated circuit ). the ASh w as 
developed through a partnership of two teams of engineers, 
one from our laboratory and one from the ASIC vendor, 
which in this case was the 111* Integrated Circuits Business 
Division. The team from our laboratory was responsible for 
defining the overall architecture of the chip, that is. the 
overall hierarchical block diagram consisting of data path 
and control, and the functional description of each module. 
The vendor team's main contribution was custom design of 
the data path and implementation of the ASIC's infrastruc- 
ture, such as pads, scan chain, JTAGt circuitry, clocking net- 
work, and the like. Our team was responsible for conveying 
the logical architecture and functional description of the Chip 
to the vendor team, and was also responsible for verifying 
the functional design through (primarily I \ erilog simulal ion. 
The vendor team was responsible for turning the Verilog HDL 
(hardware description language) functional descriptions 
into an equivalent physical design. 

It soon became clear that if this div ision of labor was going 
to succeed, the quality and accuracy of the documentation 
used to convey the chip's functional behavior to the vendor 
had to be ensured. Most of one designers ((referred to docu- 
ment the overall architecture graphically, and had often 
done so by drawing block diagrams with their favorite 
graphics editor. However, to verify the functional design 
through simulation. Verilog HDL descriptions have to be 
developed. These descriptions are also used for synthesis 
of the chip's control logic via the Synopsys toolset ( from 
Synopsys. Inc.). This present ed an apparent dilemma: the 
best way to convey the high-level functional design to the 

t JTAG is the Joint Test Action Group, which developed IEEE standaid 1 149.1. IEEE Test Access 
Port and Boundan-Scan Architecture 



vendor was through schematic graphics, but the only way to 
desc ribe the functionality precisely was through textual 
HDL models. If our designers attempted to maintain both 
forms of description, we faced duplication of effort (essen- 
tially describing the block diagram twice, once graphical!) 
and once texfually), and the possibility of differences be- 
tween the functional schematic block diagram giv en to the 
v endor and the Verilog 1IDL used for simulation (see Fig. 1 ). 

Goals and Tactics 

One way to solve this dilemma would be to develop tools to 
compare the topology represented by the schematic docu- 
mentation to that of the Verilog models, and manually recon- 
cile any differences. Another approach would be to try to 
convert the Verilog models into schematic diagrams program- 
matically. This approach was discarded because it entailed a 
lack of control over die aesthetic form of t he drawings. The 
goal we ended up pursuing w r as to find a way to simulate the 
documentation, that is. to remove the possibility of disparity 
between the schematic documentation and the Verilog HDL. 

We chose three tactics to achiev e this goal: 

• Use electronic schematic capture to produce the documenta- 
tion and the Verilog HDL models. Develop a set of tools and 
processes that ensure that the hierarchical block diagrams 
and the Verilog netlists are products of one and the same 
database. 

• Design the tools and processes to enforce a policy that pre- 
vents the extracted Verilog text files from being Indepen- 
dently altered. All changes to the Verilog models must be 
effected through the schematics so that disparities are 
rigorously eliminated. 
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dcs2ver I ICS comes with a powerful language called DDL 
(Design Database Language.) for accessing the database rep- 
resenting a schematic. Several years ago, a DDL program 
called dcs2ver was wrilten by our productivity group to fa- 
cilitate the functional verific ation of hierarchical printed 
circuit board schematics through Verilog simulation. 1 It was 
a natural choice for our application. 

Briefly. dcs2ver traverses the hierarchy of the schematic' and 
produces a Verilog module definition for each unique symbol 
. i idled a design) in the schematic. Each module definition 
contains the required port declarations, as well as module 
instantiations representing all instantiations of symbols on 
the circuit pages of the design. The result is a set of files, 
one module declaration per file, thai represents the hierar- 
chy of the ASIC as a component-oriented netlist expressed 
in Verilog HDL. 

NgleTalkll. NgleTalkll is a name given to our laboratory's 
latest generation of simulation, configuration, debugging, 
and regression testing tools - It is listen! here because il 
facilitated the regular testing of dcs2ver-extracted Verilog 
modules against a mature suite of test scripts written in the 



Fig. 1. She designers' dilemmu: the Murk diattram had to he de- 
scribed twice, once graphically mid OBCC tcxtually, ;iiul there was ■ 
pussilnlity of differenc es between 'he block diagram given to tiw 
vendor and the Verilog description used for simulation The brick 
wull symbolizes the lack of connection between the I WO forms of 
description. 

Design the tools and processes to be integrated smoothly 
with the existing simulation and regression testing environ 
meni. This allows the extracted Verilog models to be easily 
verified alongside the handwritten models 

Major ( nmponeiits of the Solution 

Our goals were achieved by knitting together tools we had 
"lying around the house" by means of some tool enhance- 
ments, bug fixes, and shell scripts. This approach was in 
keeping with the grass-roots nature of the effort; we had 
neither the time, the funds, nor the inclination to search the 
commercial marketplace for a solution. We were committed 
to choosing the best tools from among those currently avail 
able in our laboratory and integrating them into it solution. 
Some pieces of the solution were internal and some were 
commercial. The major components of the solution are 
described in the following paragraphs I see Fig. J). 

Design Capture System. We c hose the Design Capture System 
( I >( S), version .">. 10. from Zukcn I formerly from III') as our 
schematic capture tool. Some of the attributes Of I K S that 
made it an attractive Choice are: 

It is a true hierarchical schematic capture tool, not merely a 
graphics editor that has been coerced into capturing ASIC 
topology. Il implements hierarchy naturally, and has a rich 
set of built-in features that promote circuit consistency and 
discourage- wiring errors. 

All of our designers were proficient at using il because it 

had been the tool of choiee for many years for the capture 

Of printed circuit board designs. 

A Verilog extraction tool, dcs2ver, had already been written 
for it 
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NgleTalkll language. In other worrls, NgleTalkll made ii easy 
to "simulate the documentation" on a daily basis. 

History Management System. The History Managemenl System 
( HMS), the internal predecessor or HP's Soft Bench CM prod- 
uct, is a set of tools that manage versioned files in a net- 
worked environment^ It provides mutually exclusive edit 
access and revision control through a set of client com- 
mands reminiscent of the standard BCS (Revision Control 
System I e mauds of the I "NIX " operating system. 

The consistent and universal use of HMS by our design team 
OR all design files made it easy to enforce the policy of disal- 
lowing independent modification of the DCS files and t he 
derived Verilog files. This was achieved simply by cheeking 
in (placing under HMS control) the original DCS database 
files, and purposely not checking in the dcs2vei-extracted 
text files. We used HMS to help ensure that the Verilog em- 
bodied in the DCS schematics was extracted strictly from 
those schematics. Since the Verilog files were absent from 
the HMS server, the only way to gel them (and be sure they 
were correct ) was to play by the rules and use dcs2ver. Thus 
a typical design change to the high-level structural Verilog 
required locking the necessary DCS tiles, making the neces- 
sary graphical edits via DCS, checking in the modified DCS 
tiles, and running dcs2ver, 

Glue and Enhanc ements 

The major components of our solution were integrated 
through a set of "glue" programs and procedures and 
enhancements to the existing components. 

dcs2ver Enhancements. As mentioned previously, dcs2ver was 
originally written for board simulation. Our use exposed 
several weaknesses and bugs, which we fixed. Some of the 
more notable enhancements were: 

• The ability to allow DCS net aliases and splitters with alias 
labels. I 

• The ability to use DCS net "bundles" ( heterogeneously 
named buses). T and to control whether a given bundle is 
translated to a Verilog concatenation or a set of scalar port 
connections. 

• Control over whether a module is instantiated with ports 
connected by position or by name. 

• Detect ion of duplicate module names. 

HMS Enhancements. As mentioned above. HMS was a kej 
component in our solution, rnfortunately. at the lime we 
were developing our solution. HMS did not "version" (keep 
old revisions of) non-ASCII files. Not willing to lose this ca- 
pability for our DCS files, we wrote a set of Korn Shell 
scripts, called rawfei. rawfeo. rawfutil. and rawfhist. on top of the 
similarly named standard HMS client commands. These 
scripts allowed the DCS files 10 be fully versioned in a man- 
ner that is transparent to the user. This enhancement saw 
wide use for other types of non-ASCII files, and has since 
been incorporated into standard HMS. 

t Net aliases are a DCS construct. may allow a net to be referred to by another name, an alias 
Splitters with alias labels are a means of aliasing net names when splitting oft elements of 
Buses Bundles are like buses, except that each element of a bundle can have a name that is 
not related to any other element 



make netlists. Not all users of our dcs2ver-extracled Verilog files 
had the training, license, or inclination to run DCS to extract 
the netlist files. To accommodate these users, scripts were 
developed whose invocation was initiated from a make(l) 
command. This approach was congruent with the existing 
NgleTalkll env ironment, in which users were accustomed to 
performing the sequence 

(update; make; vsim 

which causes new copies of out-of-date files to be fetched, 
C-language models to be compiled if necessary, and a Verilog 
simulation to be stalled. We added a netlists target to the 
makefiles which was referenced by the default target. 

Briefly, the netlists target conditionally causes a shell script 
named extract_netfiles to he stalled which runs dcs2ver under 
the terminal form of DCS, called DDAS (Design Database 
Access System ). If the user has a license to run DDAS. 
dcs2ver is executed locally: otherwise, an HP Task Broker' 
job is submitted to a DDAS server, In either case, the needed 
dcs2ver-extracted files are deposited on the user's machine in 
a few minutes. 

Observations 

Our approach to the use of schematic capture in the design of 
this ASIC was a tolerant one: our designers were free to use 
DCS as much or as little as desired. The typical designer did 
not capture a DCS design for every module in the hierarchy 
of tite ASIC, but only went a few levels below the top level 
and then switched over to hand-generated textual Verilog 
for those modules that were predominantly behavioral as 
Opposed to structural. One designer had a depth of zero (as 
measured from the top level) in the DCS hierarchy. Another 
used DCS only for the data path, leaving the control to a text 
editor. villi. The other two designers fully embraced the ex- 
periment, having a depth of five in some places. 

Our use of DCS for high-level hierarchical cap! tire was gen- 
erally successful at meeting out' goals. The most significant 
complain! was directed at our strict enforcement of the 
policy of not checking extracted netlists into I IMS. The path 
to get extracted Verilog was somewhat complex in its imple- 
mentation, especially for those who relied on I he remote 
DDAS service. We had some occasional downtime because 
of licensing and IIP Task Broker administration problems. In 
retrospect, it probably would have been more reasonable to 
check the extracted Verilog into I IMS as nonversioned raw 
files, and use a cron(lm) job to do a daily make netlists to keep 
them up to date, thereby also ensuring that any direct 
textual edits were obliterated. 

Another flaw in our approach was that it entailed a duplica- 
tion of schematic capture effort. The v endor designers nor- 
mally captured schematics in their environment from 
textual Verilog supplied by us. In the case of this ASIC, they 
found themselves capturing schematics whose top levels 
were essentially identical to the corresponding DCS sche- 
matics. As a result, we are already taking the next obvious 
evolutionary step: our designers are now directly capturing 
top-level schematics using the vendor's environment and are 
sharing files with the vendor via HMS. 
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Design and Development of a 120-MHz 
Bus Interface Block Using Standard 
Cells and Automatic Place and 
Route Tools 



The RWJO block runs at 120 MHz and interfaces the master memory 
controller chip's 60-MHz core with the 120-MHz processor bus drivers. A 
design approach using standard cells, automatic place and route tools, 
and a powerful database management and build tool was used to 
construct the RWJO block. This approach was chosen over a full custom 
or data-path solution because of its reduced risk and the flexibility of the 
design tools. 



by Robert E. Ryan 



The master memory controller chip is one of three ASICs 
(application-specific integrated circuits) that make up the 
memory subsystem of certain HP workstations and business 
sen ers. The chip interfaces with the processor via the pro- 
cessor bus, which runs al 120 MHz. It also connects to the 
oilier memory subsystem components via the memory bus. 
which runs al 60 MHz. Most of the internal logic of the chip 
runs at 00 MHz. The RWJO block, a portion of lite chip's 
logic that runs at 120 MHz. transfers data between the pro- 
cessor bus drivers and the (iO-MIIz core logic. 

Functional Description 

The RW K ) high-speed interface block is designed to trans- 
fer data and control between the processor bus running at 
120 MHz and the core logic of the master memory controller 
chip, which runs at (50 MHz. To transfer data from (he pro- 
cessor bus efficiently requires twice the bandwidth at the 
00-MHz interface, hi operation, two cycles of the 120-MHz 
data and control signals are registered and (hen the regis- 
tered information is transferred on the next rising edge of 
the 00-MHz clock. Fig, I is a schematic diagram of the 
RWJO input logic. 

The data transfer is synchronized by delaying the 60-MHz 
clock by 4.166 ns with respect to the rising edge of the 
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120-MHz clock (Fig. 2). This synch ionization scheme re- 
quires that the register-lo-register transfer of data from Ihe 
120-MHz lo Ihe 00-MHz clock domains occur within 4.100 ns 
worst case. The reverse principle is used for transferring 
data from the core of the master memory controller chip out 
onto the processor bus. Data and control information is 
transferred from the 60-MHz to the 120-MHz domains within 
the R\V_I( ) block. This information is ihen multiplexed at the 
120-MHz rate and presented to die processor bus drivers. 

A special case exists when the processor bus is idle and we 
wish to present Ihe data directly from the 60-MHz core to 
the processor bus Without registering and multiplexing at 
Ihe 120-MHz rate. A special path (fast path) exists to handle 
this case. This path also has ihe requirement of transferring 
data from Ihe 00-MIIz to the 120-MHz domains within 4.166 
ns. Fig. 3 illustrates the liming of ihe fasi paih. and Fig. 4 is a 
schematic diagram of Ihe RW If) oulpul logic. 

Design Architecture 

Five distinct functions are required to transfer data be- 
tween the processor bus and Ihe core logic. With these li\ e 
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Fig. 1. Input logic of the RWJO block. 
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Fig. 2. HeliHioiislupofil,,. 120-MHz clock to the lin-MHz clock. 
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basic functions defined, a bit slice design approach was 
taken to implement the entire functionality. A bit slice 
macro was built foi each of the five functions using stan- 
dard cells and Cell:! place and route tools from Cadence 
Design Systems. Inc. The bit slices were stacked together 
horizontally to create the complete R\V_I<> interface block. 
The following table defines the five bit slice functions and 
their macro names. 

Function Name 

Input only, 2 bits RWI2BS 
Input only, 3 bits RWI3BS 
Bidirectional transfer with fast path RWIOBS 
Hidirectional transfer with fast path RWIOVBS 

and processor bus output gated 

with data.valid 
Bidirectional transfer with fast path RWAOIOBS 

and multiplexing for address 

and data 



CICRW 
120 MHi 



416 ns 



CK1X 
60 MM; 



Register 60-MHz > 

Cote Data 

Transfer Fast Palh Dala 
lo Processor Bus Driver 



Fig. 3. Fast path liming. 

Cadence < »pus framework tools. These abstracts were then 
used to build up the complete RWJO functionality. 



Physical Bit Slice Construction 

Because each of the five functions Required a limited number 
of design elements, a semicusioni implementation using 
standard cells was chosen. The most complicated function, 
RWADIOBS. required 1" cells. The five functions were placed 
and routed using a proprietary tool called Autopr 1 and 
Cadence Cell-'!. Autopr was used to generate the bit slice 
bounding box and Standard cell rows and to place the I/O 
polls. Special care was taken in cell placement and I he rout- 
ing of the clock signals. Scan control signals and power and 
ground signals were routed so that connections could be 
made by abutment when the bit slices were stacked to- 
gether, i (nee the construction of the bit slices was complete. 
CellS abstracts were generated for each bit slice using the 



Physical Block Assembh 

The top-level Verilog netlist for the R\V_K ) block was gener- 
ated by a script in such a manner that the individual bit slice 
functions were declared in the order which they physically 
appear from left to right within the UW It ) block As part of 
the netlist generation a stackup file was created which de- 
fined the order of the bit slice elements, the puis on each bit 
slice corresponding to pons on the top and bottom of the 
block, and the direction of each pin (in or out ). A simple awk 
program was developed that read the stackup file and 
created two command files for Cell;!. The first file directed 
the placement of the pins on the block to line up w ith the 
appropriate bit slice. The second command file directed 
Cell'! lo place the bit slice components in the order defined 
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Bit Slices 



Bil Slices 



Standard Cells 
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Bit Slices 



Standard Cells 



Power and GND 

by the stackup nie, The RVV_IO block was separated into 
four sections to allow the main power, ground, and clock 
signals to pass through the center of the block and to allow 
for clock tree taps (see Fig. 5). 

The block has a single standard cell row along the bottom 
where clock buffers and a small amount of combinational 
logic reside. CeI13*s clock tree synthesis capabilities were 
used to insert buffers in I he global data control signals 
(holdjbL, hokLcdL, mux_ctrl_rvv_0. mux_ctrl_rw_l, mux_ctrLrdata. 
return_byte_swap). The routing of clock. Vjjj, and GND signals 
was customized using specific Cell'! commands. 

Characterization 

In the early stages of development each bit slic e function 
was characterized separately using Aida's Tinn er static tim- 
ing analysis tool, with lumped capacitance and distributed 
KC delay information back-annotated Bom CeD3. Timing 
libraries were generated automatically by Tinner for each 
function. A total of eight Tinn er runs were required to char- 
acterize all the functional paths in each bit slice. The results 
of the eight analysis runs were merged into a single liming 
model of the bit slice. A new Verilog netlist was generated 
from the physical Cell:? database thai included the buffers 
inserted by Cell.'J. The libraries and lite new Verilog netlist 
were used for the initial master memory controller chip top- 
level timing analysis. Final top-level timing analysis used a 
Verilog netlist back-annotated from CelKland full distributed 
RG back-annotation for the block, instead of the Timver- 
generated timing libraries. This reduced the potential for 
error during final timing analysis. 

Metal Migration Analysis and Power Bus Sizing 

The RWJO block consists of ST bit slices, 68 of which are 
I he RWADIOBS design. Because the RWADIOBS is the most 
complex macro and makes up most of the RWJO block, it 
was assumed that all S7 bit slices were of this type for the 



Fig. 5. RWJO block laj 



metal migration analysis. The first step in the analysis was 
to determine the current required by each element in die 
RWADIOBS macro. This Was done by lirsl calculating the 
amount of capacitance being switched by each input of 
every cell and I hen the capacitance being switched by each 
Output, which was the sum of the device output drivers and 
the wire load (back-annotated from ihe layout ). Once this 
was done, the equation I ave = CVf was used Co determine die 
current switching of each element. The current require- 
ments of the elements were summed to determine Ihe total 
for the RWADIOBS block. This value was used to determine 
the total currenl required by the RWJO block and to size 
the power and ground buses appropriately. 

Verification and Extraction 

The fully placed and routed block-level database was 
brought into the Cadence Opus framework where a GUSH 
and CDL1 netlist of the complete RW_I< > block was gener- 
ated. This data was then transferred to Mentor Graphics" 1 ' 
CheckMate tool where layout -versus-schematic, design rule, 
and electrical rule checks were performed. Checkmate was 
instructed to flatten ihe database to ihe standard cell level 
and then perform a complete distributed RC extract. This 
data along with the back-annotated netlist was then used for 
final full-chip static liming analysis. 

Build and Design Data Management 

The entire design process, from the construction of Ihe bit 
slices to final analysis of the RWJO block was managed by 
the Atria ClearCase tools. ClearCase is designed for manag- 
ing large software development projects. The ClearCase 
tools provided a development environment with configura- 
tion management, revision control, and build management. 
ClearMake. ClearCases make-compatible build lool. was 
used to build all the parts of the RWJO block automatically. 

t GDSII and COL are industry-standard formats lor data interchange. 
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Fig. 6. Fn-si version of the 
RW JO block. 
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Processor Bus I/O Drivers 




Fig. 7. KVi i<> block redesigned 

for tnm conservation ami inclu- 
sion of littlo endian functionality 



Processor 8us I/O Drivers 




Fig. s. RWJO bloi k with 
relocated power rails 



Makefiles were generated to optimize the overall construc- 
tion process and to allow for efficient rebuilding if necessary. 
CleaTMake's parallel distributed building capabilities greatly 
improved the efficiency oflhe huild process by parallelizing 

the construction of the independent sections and dtsttibut- 

Ulg the build processes across the neiworked nuichines. 
During all I mild steps I 'learMakc performs auditing of lhe 
build processes. ClearMake keeps track of all the Hies read 
and written (luring the build and creates an audit trail called 
a configuration record which is kepi with the built Object 

( derived Object ). The configuration records are used by 

future builds i" determine if the object is out of date and 

needs (0 be rebuilt < -learMake examines the versions or all 

ii lements referenced in the configuration record to deter- 
mine if a rebuild is necessary. Il does not rely on lhe "dalc- 
liiue-inodificd" oflhe object The configuration records can 
he examined by the developer and used as a source of bisnny 

information regarding any derived object 
Summarj 

hilling the course oflhe master memory controller chip de- 
sign the RW_I( I block went through man\ changes. The ini- 

tiai specification required thai the block be long and narrow 

and cover the entire side oflhe chip that interlaces with lhe 

processor bus (see Pig. 6). 

Later in the project, area became critical, and it was neces- 
sary to reduce the size of the block. \n additional r<i|iiire- 
ment on the master memory controller chip was thai it had to 

support little endian byte order i least -significant byte is byte 

II). The structure of the KWK ) block was ideally suited to 

implement the little endian functionality which required byte 
swapping the data returned from memory before delivering 

ll tO the processor bus (see Rg, 7). 



The original specifications called for the main power and 
ground buses to pass through the center of the RW_IO 
block. Toward the end of the Chip developmenl the power 
buses changed and the Vm, bus had to be moved. This again 
required reconstructing the UW ID block (see Fig. 8). 

The use of standard cells and automatic place and route 
tools for the construction oflhe R\V_ I( ) block proved to be 
very advantageous. Hccau.se of the speed ami flexibility of 
the lools the design team was not hindered when making 
changes to the high-speed interface block as they might 
have been if a full custom approach had been pursued. The 
most complex change to the block, which required rebuild- 
ing all oflhe bit slices and resizing and reconstructing lhe 

block, look only three days to complete, at which tithe the 

block was fully verified. 

The design approach of using standard cells and seiuicusloni 

layout techniques was favored overs data path or full custom 

implementation because of its reduced risk However, GBf 
schematics were generated for documentation purposes as 
well as a fallback position if a dala-palh solution had been 

required. The c bination of standard cells, custom Celi3 

layout, and accurate static liming analysis proved to be an 
effective solution for the RW_ K > high-speed interface block 
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development for ihe CE instrument usei interlace 
reported in this issue Alwin was born in Kenzmgen. 
Germany, is interested in PC hardware and software, 
and enioys karate, scuba diving, and skiing. 
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UMteJagk 

Ulnke Jegle was born in 
Karlsruhe, Germany Site 
studied chemistry at the 
University of Karlsruhe, 
graduating m 1984, then 
earned a PhD degree in 
chemistry from the Univer- 
sity of Karlsruhe for work on 
separation of radioactrve 
compounds in saturated salt solutions. Before join- 
ing HP's Waldbronn Analytical Division in 1991. she 
was with the Nuclear Research Center of Karlsruhe 
where she worked on chemical sensor coatings and 
analysis using chemical sensors She is presently a 
project leader for the development of liquid-phase 
separation systems tor capillary electrophoresis 
Ulnke is interested in separation science, surface 
chemistry, and sensors She has several publications 
in the areas of radioactive compound analysis, chem- 
ical sensors based on field-effect transistors, and 
analysis of biomolecules by capillary electrophoresis 
She is a member of the GDCH IGesellschaft Deut- 
scher Chermker) 



57 Column Technology 
Sally A. Swedberg 

Sally Swedberg is a 
^^K^^^^ membei nf the 

j^j^f^^B staff of HP I aboratones 

, W " I HP in 1986 She 

f fj '■ tree in 

V analytical biochemistry in 
\ "991 Iroin •'«• Ui iv-;i:-iv ':i 
p . California at Santa Cruz 
• Shu worked on column tech 
nology lor the capillary electrophoresis separation of 
biomolecules as reported in this issue, and is pres- 
ently responsible for investigating future bioanalysis 
technologies Belore coming to HP. she woiked in 
the area of m-vitro diagnostics research and manage- 
ment Her work has produced eight patents related 
to modified surfaces for separations in liquid chroma- 
tography and capillary electrophoresis Publications 
include ten papers in the areas of bioanalysis, use of 
FTIR spectroscopy in bioanalysis and bioseparations 
of proteins She is a member of the American Asso- 
ciation for the Advancement of Science, the Protein 
Society, and the American Chemical Society She is 
interested in protein/surface interactions and protein 
structure and function Born in Berkeley California, 
Sally is a member of the Humanist Community and 
DAWN Other interests include hiking, botanizing, 
theater, and symphony 
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An R&D chemist at HP's 
Waldbonn Analytical 0M- 
. Monika Oittmaro has 



ft 

^^^^ E 

contnbutions at HP have been in the area of columns 
tor protein separations in liquid chromatography and 
capillary electrophoresis instruments She attended 
the Ruhr University at Bochum. receiving a Diplom m 
Chemistry in 1981 and a PhD in chemistry in 1986 tor 
work on supercritical fluid-phase equilibria Previous 
professional experience includes work as a postdoc- 
toral fellow at the University of California at Berkeley 
on theoretical studies of fluid-phase equilibria from 
1986 to 1988 She is interested in physical chemistry 
and is an author or coauthor of papers on phase equi- 
librium thermodynamics and symposium presenta- 
tions on separation science Monika was born in 
Essen. Germany She is married, has two sons, plays 
piano, and enjoys horseback riding. 
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Gary B. Gordon 

Gaiy Gordon was the 
project manager for the HP 
Laboratories phase of Ihe 
capillary electrophoresis 
detector project He joined 
HP full-time in 1966 as a 
digital designer on the com 
puling counter project. HP's 
first arithmetic unit to em- 
ploy digital ICs later he became project manager 
and then section manager for HP's first laser interfer- 
ometer Gary is perhaps best known for pioneering in 
Ihe 1970s HP's entry into instrumentation for digital 
designers with such instruments as the logic probe, 
clip, and pulser. Ihe logic analyzer, and the signature 
analyzer In 1979 he transferred to HP's central re- 
search laboratories, where he has served as proiect 
manager foi a series of products Inr Ihe HP Analytical 
Products Group, including the 0HCA robot and the 
micromachined valve Recently he transferred to HP's 
technical ladder and is currently a senior research 
engineer Gary received a BSFF degree in RF commu- 
nications from the University of California at Berkeley 
in 196? and an MSEE degree in computer design 
from Stanford University in 1970 He has authoied 
over a dozen technical articles, has had products fea- 
tured on 1 1 magazine and annual report covers, and 
is named as an inventor in 26 patents He served 
loui years as a U.S. naval officer, and is an associate 
professor at California State University at San Jose 
His interests include photography (he shot this issue's 
cover), tennis, flying, classical music, and designing 
and building modern furniture and houses 
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Richard P. Telia 

A native of Utica. New York. 
Rich Telia attended the Uni- 
versity of Rhode Island, 
where he received a BSEE 
degree in 1978 and an 
MSEE in 1980. He is a prin- 
cipal project engineer with 
the manufacturing systems 
and technology department 
ol HP Laboratories where he first began his HP career 
in 1983. His current responsibilities include develop- 
ment of assembly-and-test workcells for fiber-optic 
components and the introduction of new assembly 
technology into HP Previous HP contributions include 
work on automated assembly technology for printed 
circuits, microrobotics, and a protutype inkjet pen 
assembly system His work has produced six patents 
in the areas of robotic systems and end effector com- 
ponents Before joining HP. he was a research spe- 
cialist with the University of Rhode Island industrial 
participation program where he focused on research 
for sensor-based flexible robotic assembly systems 
from 1 980 lo 1982 With interests in computer vi- 
sion, robotics, and flexible automation and assembly, 
Rich has authored or coauthoied eight papers in the 
areas of robotics, automation, and assembly automa- 
tion He developed the concept and design of the 
BubbleWoild lathe and controller for the pmjecl re- 
ported in this issue. He is married, has four children, 
and teaches computers to fourth graders at a local 
school Other hobbies include woodworking, camp- 
ing, backpacking, and skiing 

Henrique A.S. Martins 

f Henrique Martins was born 
in Lisbon. Portugal He re- 
ceived an electrical engi 
neering degree from the 
Instituto Superior Tecnico, 
Lisbon ill 1976 and MS and 
PhD degrees in electrical 
engineering from the Univer- 
sity of Rhode Island in 1980 
and 1982. respectively He has held teaching and 
research positions at the departments of electrical 
engineering of both the Instituto Superior Tecnico 
and the University of Rhode Island. Since 1985 he 
has been a member of the technical staff at Hewlett- 
Packard Laboratones. His research interests lie in 
the areas of computer vision, camera calibration, and 
control of robotic systems 
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Tom A. Skeie 

I A native of Kristiansand 
f ~ Norway. Tom Skeie attended 

the University of Wyoming 
t~-"t ' rnm which he received a 
jr^^^^V BSEE degree in 1 984 and an 
MS in computer science in 
NJSMj^ 1989. He is an R&D engi- 
^j^l^Hw), neer a < HP s Storage Solu- 
'MrlitU^^Uttlmh jions Division and since join- 
ing HP in 1992 his responsibilities have included RSD 
engineering foi hardware qualification proce- 
dures, PC storage product software design and devel- 
opment, and coordinating engineering development 




issues with vendors. Tom was a lead engineer for 
the HP Disk Array project. Before coming to HP he 
was an R&D engineer for Extended Systems Inc. in 
Boise. Idaho, and an engineer for the Norwegian 
Telecommunications Administration in Oslo. Norway 
He served one year in the Norwegian Air Force Tom 
is inanied. has a son. and enjoys snow skiing, hiking, 
soccer, and racquetball when time allows after being 
a husband, dad, and student working on an MS de- 
gree In engineering management. 

Michael R. Rusnack 

A program manager at HP's 
Storage Solutions Division, 
Michael Rusnack was re- 
sponsible foi managing soft- 
ware design, develop- 
ment, and test tor the HP 
Disk Array controller. His 
current responsibilities con- 
tinue to be in the area of PC 
data storage Previous HP accomplishments include 
work in product assuiance, manufacturing, R&D engi- 
neering, and RSD management for PC information 
storage products. His work has resulted in a patent 
for data integrity assurance in a disk drive upon 
powei failure and a patent for a powerfail-protected 
memory module He has authored articles on disk 
recording technology and SCSI, and various field pub- 
lications on topics concerning engineering environ- 
mental specifications He received a BS degree in in- 
terdisciplinary engineering in 1976 and an MS in 
electrical engmeenng in 1978 bath from Purdue Uni- 
versity. He was born in East Chicago, Indiana and 
served four years in the United States Air Force. 
Michael is married, has a son. and enjoys studying 
karate, weight lifting, race walking, and cross-coun- 
try skiing. He also likes woodworking and playing 
with PCs both at home and at work His civic activi- 
ties include volunteer work for the March of 
Dimes Foundation. Toastmasters, and college recruit- 
ing at Purdue 

82 COBOL SoftBench 



Cheryl Carmichael 

~ With HP since 1988. Cheryl 
Carmichael is a lead learn- 
ing products engineer at 
HP's Software Engineering 
Systems Division. She 
has worked on hardcopy 
manuals, online help, and 
computer-based training for 
Softbench Encapsulator, C 
Softbench, C-h- Softbench, and COBOL Sultbench 
products. A Rocky Mountain naiive. Cheryl headed 
west and received her BSEE degree from California 
Slate University at Fullerton in 1981 She is married 
and has two children. Her outside activities involve 
working with senior citizens 
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David A. Burgoon 

^^^^ Born in Toledo, Ohio, Dave 
^P^^^V Buiguou is a membei of the 

, Ik technical staff at the Work- 

M <fc ■ station Systems Division, 

T W He |oined HP in 1981 at the 

* " f Desktop Computer Division. 

Currently involved with 
graphics hardware lab engi- 
neering productivity, he is 
responsible for tools procurement, integration, and 
support, and for design environment and methodolo- 
gies engineering. He received a BSEE degree Iram 
the University of Toledo in 1981 and an MS in com- 
pulei science from Colorado State University in 1989 
His previous experience at HP includes work on the 
HP 9836C graphics display hardware and hardware 
for ihe SRX. TurboSRX. TurboVRX. CRX24, and 
CRX24Z graphics accelerators. Dave was responsible 
foi designing portions of the ASIC reported in his 
article, which is used in the HCRX graphics hardware 
family He is a member of the IEEE, has a patent 
pending relating to read concurrency through transac- 
tion synthesis, and is interested in computer graphics 
haidware architecture and haidware design tools and 
methodology His publications include a 1989 HP 
Journal article concerning radiosity and an article on 
SRX acceleratoi hardware architecture that appeared 
m Electronic Design. Dave is married, has two chil- 
dren, and enjoys car repair, bicycling, reading science 
fiction, and tinkering with electronics. 
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Robert E. Ryan 

A VLSI design engineer 
with the Woikstation Sys- 
tems Group. Bob Ryan joined 
the Apollo Systems Division 
in 1 989 after receiving his 
BSEE degree from the Uni- 
versity of Massachusetts at 
Dartmouth He is currently a 
project manager for develop- 
ment of HP's next generation of high-end work- 
stations He was a design engineer in charge of prot- 
ect data management and tool integration, and he 
constructed two high-speed interface blocks for the 
project reported in this issue His previous HP experi- 
ence includes work on numerous IC design projects 
and I/O and memory controllers. speciah?ing in physi- 
cal design and layout of clock distribution systems. IC 
design environments, and design data management 
He is professionally interested in IC design data man- 
agement and has authored papers for the 1991 and 
1994 Design Technology Conference about physical 
clock synthesis, data management, and high-speed 
interface design 
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